-- Logs begin at Thu 2022-06-30 15:19:05 UTC, end at Thu 2022-06-30 16:51:04 UTC. -- Jun 30 16:24:38.947508 dv-cinder-836027-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 16:24:38.956065 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 16:24:38.958550 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 16:24:38 2022] *** Jun 30 16:24:38.958550 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 16:24:38.958550 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 16:24:38.958550 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: nodename: dv-cinder-836027-2-iscsi Jun 30 16:24:38.958550 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: machine: x86_64 Jun 30 16:24:38.958550 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: clock source: unix Jun 30 16:24:38.958550 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: pcre jit disabled Jun 30 16:24:38.958550 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: detected number of CPU cores: 4 Jun 30 16:24:38.958550 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: current working directory: / Jun 30 16:24:38.958550 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: detected binary path: /usr/bin/uwsgi-core Jun 30 16:24:38.959302 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: your processes number limit is 47680 Jun 30 16:24:38.959302 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: your memory page size is 4096 bytes Jun 30 16:24:38.959302 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: detected max file descriptor number: 2048 Jun 30 16:24:38.959302 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: lock engine: pthread robust mutexes Jun 30 16:24:38.959302 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: thunder lock: enabled Jun 30 16:24:38.959302 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 16:24:38.959302 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 16:24:39.002404 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: Python main interpreter initialized at 0x55a6c96cb9c0 Jun 30 16:24:39.002404 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: python threads support enabled Jun 30 16:24:39.002404 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: your server socket listen backlog is limited to 100 connections Jun 30 16:24:39.002404 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: your mercy for graceful operations on workers is 90 seconds Jun 30 16:24:39.002775 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 16:24:39.002842 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: *** Operational MODE: preforking *** Jun 30 16:24:39.003113 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: *** uWSGI is running in multiple interpreter mode *** Jun 30 16:24:39.003113 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: spawned uWSGI master process (pid: 103643) Jun 30 16:24:39.003321 dv-cinder-836027-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 16:24:39.003904 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: spawned uWSGI worker 1 (pid: 103644, cores: 1) Jun 30 16:24:39.004253 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: spawned uWSGI worker 2 (pid: 103645, cores: 1) Jun 30 16:24:39.005100 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 16:24:39.679403 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 16:24:39.681926 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 16:24:40.832140 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 16:24:40.832140 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: from cryptography.utils import int_from_bytes Jun 30 16:24:40.832744 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 16:24:40.832744 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: from cryptography.utils import int_from_bytes Jun 30 16:24:40.838242 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 16:24:40.838242 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: from cryptography.utils import int_from_bytes Jun 30 16:24:40.838713 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 16:24:40.838713 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: from cryptography.utils import int_from_bytes Jun 30 16:24:43.381940 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 16:24:43.382531 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 16:24:43.382709 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 16:24:43.383083 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 16:24:43.383169 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 16:24:43.383248 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 16:24:43.383334 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 16:24:43.383522 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 16:24:43.383732 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.383897 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 16:24:43.384063 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.384218 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 16:24:43.384386 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.384536 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.384709 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.384841 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.385042 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.385170 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.385363 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.385459 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.385692 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.385823 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.386007 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.386100 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.386337 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.386431 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.386598 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.386706 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.386913 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.387013 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.387239 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-2-iscsi {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.387331 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.387587 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.387695 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.387899 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.388006 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-2-iscsi {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.388211 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.388305 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.388523 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.388605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.388826 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.388918 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.389145 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.389234 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.389447 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.389530 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.389771 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.389947 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.390080 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.390402 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.390586 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.390700 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.390903 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.391007 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.391210 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.391319 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.391556 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.391676 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.391899 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.392005 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.392216 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.392320 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.392532 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.392653 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.392871 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.392992 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.393191 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.393383 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.393669 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.393789 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-2-iscsi {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.394011 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.394138 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.394295 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-2-iscsi {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.394420 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.394566 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.394681 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.394930 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.395088 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.395254 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.395432 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.395617 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.395895 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.396065 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.396232 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.396408 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.396533 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.396703 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.396824 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.397031 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.397146 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.397362 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.397461 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.397678 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.397766 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.398010 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.398104 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.398335 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.398420 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.398650 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.398735 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.398972 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.399057 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.399276 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.399401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.399614 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.399703 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.399865 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.399950 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.400175 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.400271 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.400498 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.400585 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.400823 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.400915 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.401074 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.401169 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.401388 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.401474 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.401640 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.401753 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.401982 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.402107 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.402281 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.402437 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.402588 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.402684 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.402897 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.403031 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.403203 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.403338 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.403530 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.403675 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.403841 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.403968 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.404149 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.404276 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.404455 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.404591 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.404762 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.405140 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.405340 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.405468 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.405660 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.405788 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.405977 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.406104 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.406285 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.406416 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.406601 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.406687 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.406923 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.407008 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.407237 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.407319 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.407568 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.407656 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.407898 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.407994 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.408217 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.408314 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.408535 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.408676 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.408845 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.408979 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.409163 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.409326 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.409464 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.409596 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.409766 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.409895 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.410597 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.410823 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.410968 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.411094 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.411302 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.411521 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.411654 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.411799 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.411925 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.412049 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.412173 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.412362 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.412490 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.412705 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.412834 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.413017 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.413144 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.413268 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.413400 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.413565 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.413694 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.413872 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.414010 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.414193 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.414331 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.414504 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.414635 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.414812 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.414939 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.415120 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.415255 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.415425 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.415600 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.415743 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.415867 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.416173 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.416321 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.416456 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.416578 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.416701 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.416831 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.416955 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.417087 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.417242 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.417364 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.417551 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.417665 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.417854 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.417975 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.418160 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.418285 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.418467 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.418588 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.418786 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.418910 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.419110 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.419230 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.419381 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.419563 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.419762 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.419871 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.419988 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.420093 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.420314 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.420429 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.420625 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.420751 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.420932 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.421044 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.421240 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.421361 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.421549 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.421663 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.421849 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.421961 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.422156 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.422283 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.422469 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.422604 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.422775 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.422900 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.423083 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.423216 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.423383 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.423523 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.423717 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.423857 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.424021 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.424148 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.424325 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.424459 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.424628 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.424762 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.424931 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.425056 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.425236 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.425369 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.425540 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.425667 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.426565 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.426866 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.427000 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.427137 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.427318 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.427448 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.427630 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.427765 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.427897 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.428022 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.428145 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.428268 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.428392 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.428523 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.428631 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.428788 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.428916 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.429041 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.429277 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:24:43.429419 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.429553 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.429678 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.429841 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.429969 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.430188 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.430317 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.430505 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.430648 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.430834 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.430961 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.431146 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.431274 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.431457 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.431619 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.431792 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.431919 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.432115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.432252 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.432433 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.432554 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.432781 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.432911 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.433067 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.433198 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.433383 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.433521 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.433698 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.433825 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.434011 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.434140 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.434328 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.434456 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.434646 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.434790 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.434967 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.435101 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.435285 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.435412 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.435623 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.435758 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.435927 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.436048 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.436262 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.436391 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.436589 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.436726 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.436909 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.437087 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.437281 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.437395 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.437631 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.437739 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.437947 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.438042 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.438313 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.438403 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.438587 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.438685 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.438901 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.439007 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.439216 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.439315 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.439552 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.439652 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.439867 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.439962 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.440184 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.440329 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.440496 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.440639 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.440809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.440946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.441121 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.441249 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.441467 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.441600 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.441782 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.441916 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.442094 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.442305 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.442440 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.442563 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.442713 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.442840 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.443027 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.443169 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.443340 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.443528 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.443658 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.443792 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.443967 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.444109 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.444273 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.444408 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.444585 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.444713 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.444887 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.445031 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.445252 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.445386 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.445562 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.445691 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.445872 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.446013 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.446186 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.446314 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.446492 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.446620 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.446816 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.446946 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.447163 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.447291 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.447442 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.447584 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.447772 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.447903 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.448087 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.448215 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.448398 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.448525 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.448703 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.448830 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.449012 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.449138 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.449321 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.449532 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.449669 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.449801 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.449930 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.450062 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.450223 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.450363 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.450528 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.450656 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.450845 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.450970 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.451151 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.451288 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.451464 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.451611 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.451798 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.451925 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.452104 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.452242 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.452420 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.452548 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.452736 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.452873 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.453059 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.453194 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.453370 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.453499 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.453683 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.453811 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.454008 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.454139 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.454324 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.454451 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.454640 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.454768 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.454981 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.455110 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.455316 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.455443 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.455651 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.455792 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.455960 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.456088 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.456267 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.456397 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.456572 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.456701 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.456882 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.457584 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.457713 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.457882 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.458011 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.458306 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.458445 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.458661 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.458833 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.458960 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.459084 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.459269 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.459406 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.459625 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.459754 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.459878 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.460015 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.460184 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.460320 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.460489 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.460617 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.460815 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.460943 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.461127 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.461259 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.461433 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.461561 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.461739 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.461877 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.462043 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.462171 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.462389 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.462516 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.462704 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.462841 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.463050 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.463178 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.463367 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.463533 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.463724 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.463868 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.464037 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.464164 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.464351 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.464478 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.464664 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.464805 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.464984 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.465109 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.465294 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.465419 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.465627 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.465761 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.465919 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.466047 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.466243 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.466368 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.466555 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.466682 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.466872 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.466998 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.467179 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.467306 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.467521 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.467643 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.467839 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.467942 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.468170 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.468274 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.468474 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.468577 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.468795 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.468897 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.469111 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.469258 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.469421 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.469581 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.469719 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.469859 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.470030 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.470168 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.470340 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.470468 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.470652 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.470788 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.470969 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.471108 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.471278 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.471412 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.471605 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.471729 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.471911 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.472126 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.472254 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.472379 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.472532 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.473289 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.473422 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.473591 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.473721 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.473872 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.474145 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.474274 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.474467 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.474596 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.474793 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.474922 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.475104 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.475242 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.475423 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.475574 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.475775 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.475901 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.476095 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.476236 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.476406 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.476527 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.476720 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.476846 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.477024 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.477150 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.477330 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.477459 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.477643 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.477865 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.477994 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.478131 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.478258 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.478382 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.478547 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.478673 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.478851 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.478987 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.479167 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.479328 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.479566 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.479760 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.479887 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.480075 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.480175 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.480384 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.480480 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.480698 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.480793 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.481014 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.481108 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.481323 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.481457 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.481708 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.481955 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.482195 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.482325 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.482534 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.482664 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.482864 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.483003 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.483175 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.483301 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.483525 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.483659 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.483812 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.483959 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.484120 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.484240 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.484460 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.484588 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.484773 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.484913 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.485082 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.485221 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.485393 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.485521 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.485703 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.485840 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.486016 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.486142 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.486343 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.486478 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.486657 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.486792 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.487002 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.487132 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.487328 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.487457 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.487805 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.488012 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.488140 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.488351 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.488518 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.488654 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.488816 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.488952 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.489152 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.489280 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.489477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.489614 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.489795 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.490005 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.490133 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.490257 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.490418 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.490547 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.490722 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.490850 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.491036 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.491171 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.491353 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.491508 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.491698 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.491964 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.492093 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.492301 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.492443 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.492615 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.492760 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.492959 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.493089 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.493285 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.493463 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.493676 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.493860 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.493998 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.494199 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.494329 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.494521 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.494649 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.494846 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.494984 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.495172 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.495301 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.495513 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.495645 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.495852 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.495980 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.496184 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.496310 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.496494 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.496624 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.496804 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.496942 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.497112 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.497241 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.497419 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.497629 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.497763 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.497887 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.498026 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.498227 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.498355 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.498492 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.498625 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.498750 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.498942 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.499070 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.499247 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.499384 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.499588 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.499716 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.499895 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.500033 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.500227 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.500369 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.500497 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.500636 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.500796 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.500925 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.501144 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.501270 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.501396 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.501519 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.501693 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.501819 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.502002 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.502129 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.502324 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.502450 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.502638 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.502765 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.502947 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.503075 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.503253 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.503381 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.503592 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.503721 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.503971 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.504107 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.504321 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.504448 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.504699 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.504833 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.505007 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.505135 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.505318 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.505454 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.505629 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.505770 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.505934 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.506061 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.506252 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.506378 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.506563 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.506701 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.506874 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.507001 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.507184 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.507319 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.507503 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.507637 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.507813 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.507939 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.508115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.508265 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.508469 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.508597 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.508722 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.508846 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.509014 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.509148 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.509316 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.509445 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.509626 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.509753 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.509933 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.510068 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.510217 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.510404 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.510532 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.510656 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.510816 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.510955 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.511130 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.511257 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.511430 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.511587 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.511768 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.511907 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.512072 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.512200 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.512382 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.512511 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.512691 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.512833 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.512994 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.513123 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.513316 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.513445 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.513627 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.513765 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.513934 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.514063 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.514238 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.514367 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.514547 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.514683 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.514850 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.514980 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.515153 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.515281 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.515530 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.515714 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.515843 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.515968 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.516152 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.516286 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.516457 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.516616 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.516744 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.516866 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.517052 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.517189 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.517355 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.517483 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.517660 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.517788 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.517969 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.518108 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.518272 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.518401 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.518604 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.518732 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.518856 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.518989 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.519157 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.519287 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.520021 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.520176 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.520341 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.520555 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.520684 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.520808 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.520931 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.521120 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.521250 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.521429 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.521567 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.521733 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.521958 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.522086 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.522292 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.522437 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.522610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.522754 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.522921 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.523049 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.523238 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.523377 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.523569 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.523707 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.523920 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.524056 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.524230 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.524377 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.524546 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.524673 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.524861 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.524996 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.525138 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.525263 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.525453 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.525582 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.525768 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.525905 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.526075 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.526212 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.526379 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.526509 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.526695 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.526900 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.527036 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.527189 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.527339 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.527519 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.527703 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.527843 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.528015 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.528149 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.528323 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.528452 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.528640 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.528811 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.528947 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.529091 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.529258 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.529385 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.529565 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.529702 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.530135 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.530275 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.530455 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.530678 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.530952 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.531081 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.531213 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.531345 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.531345 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.531606 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.531745 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.531869 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.531993 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.532116 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.532284 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.532423 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.532593 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.532720 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.532902 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.533038 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.533207 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.533343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.533528 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.533655 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.533836 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.533963 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.534143 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.534278 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.534452 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.534578 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.534758 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.534893 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.535088 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.535226 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.535980 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.536229 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.536368 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.536596 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.536814 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.536951 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.537138 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.537266 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.537457 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.537586 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.537770 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.537915 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.538085 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.538220 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.538398 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.538526 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.538726 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.538953 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.539059 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.539272 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.539379 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.539615 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.539770 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.539929 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.540087 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.540253 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.540400 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.540571 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.540712 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.540881 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.541017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.541303 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.541397 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.541619 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.541713 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.541930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.542014 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.542238 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.542322 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.542543 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.542628 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.542844 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.542935 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.543160 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.543244 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.543464 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.543570 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.543807 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.543925 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.544172 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.544258 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.544481 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.544567 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.544811 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.544970 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.545111 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.545249 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.545428 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.545582 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.545870 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.546015 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.546171 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.546319 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.546484 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.546638 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.546896 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.547039 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.547205 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.547358 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.547531 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.547691 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.547832 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.547969 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.548137 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.548285 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.548466 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.548620 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.548759 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.548895 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.549081 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.549235 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.549380 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.549529 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.549690 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.549853 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.550051 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.550207 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.550368 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.550523 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.550715 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.550992 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.551222 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.551374 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.551582 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.551733 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.551918 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.552071 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.552243 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.552388 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.552576 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.552724 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.552958 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.553102 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.553248 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.553387 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.553565 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.553719 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.553857 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.553994 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.554166 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.554311 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.554490 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.554654 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.554802 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.554947 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.555085 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.555230 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.555395 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.555596 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.555737 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.555876 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.556012 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.556167 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.556307 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.556459 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.556605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.556744 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.556922 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.557078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.557246 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.557391 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.557562 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.557708 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.557887 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.558044 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.558193 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.558340 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.558489 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.558627 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.558812 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.558957 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.559123 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.559268 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.559430 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.559586 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.559761 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.559855 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.560068 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.560156 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.560392 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.560540 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.560707 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.560795 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.561030 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.561125 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.561362 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.561455 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.561694 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.561780 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.562004 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.562097 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.562338 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.562433 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.562746 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.562847 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.562984 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.563081 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.563303 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.563397 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.563662 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.563757 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.563962 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.564050 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.564268 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.564364 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.564583 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.564668 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.564889 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.564982 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.565194 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.565289 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.565498 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.565579 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.565807 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.565893 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.566112 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.566199 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.566447 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.566591 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.566806 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.566966 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.567141 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.567233 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.567460 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.567647 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.567791 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.567931 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.568122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.568263 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.568409 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.568557 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.568770 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.568915 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.569063 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.569208 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.569346 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.569484 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.569623 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.569769 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.569907 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.570044 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.570181 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.570318 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.570455 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.570612 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.570799 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.570953 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.571110 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.571336 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.571581 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.571740 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.571879 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.572017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.572162 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.572298 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.572435 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.572603 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.572743 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.572878 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.573022 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.573160 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.573351 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.573505 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.573671 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.573816 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.573993 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.574137 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.574306 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.574450 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.574625 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.574769 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.574940 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.575083 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.575295 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.575523 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.575675 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.575849 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.575996 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.576165 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.576329 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.576467 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.576605 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.576779 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.577032 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.577186 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.577363 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.577516 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.577683 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.577828 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.577991 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.578143 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.578304 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.578449 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.578654 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.578811 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.578958 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.579181 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.579406 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.579574 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.579670 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.579746 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.579906 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.579997 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.580223 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.580320 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.580557 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.580644 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.580872 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.580959 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.581189 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.581276 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.581547 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.581650 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.581849 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.582491 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.582703 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.582842 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.583087 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.583344 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.583465 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.583595 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.583671 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.583830 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.583929 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.584178 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.584273 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.584494 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.584602 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.584827 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.584932 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.585139 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.585225 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.585448 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.585565 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.585766 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.585932 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.586081 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.586257 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.586411 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.586579 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.586749 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.586900 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.587072 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.587217 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.587393 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.587557 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.587742 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.588007 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.588256 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.588505 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.588505 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.588970 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.589234 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.589481 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.589724 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.589989 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.590235 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.590481 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.590733 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.590974 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.591214 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.591519 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.591519 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.592294 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.592533 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.592771 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.593019 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.593272 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.593509 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.593756 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.593987 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.594220 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.594455 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.594695 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.594946 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.595202 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.595448 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.595743 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.595997 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.596238 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.596495 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.596757 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.597003 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.597246 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.597500 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.598755 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.598755 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.599237 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.599527 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.599775 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.600020 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.600262 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.600522 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.600778 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.601020 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.601272 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.601514 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.601763 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.601763 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.602619 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.602866 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.603122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.603364 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.603649 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.603914 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.604173 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.604414 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.604669 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.604928 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.604928 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.605399 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.605641 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.605886 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.606129 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.606371 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.606626 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.606873 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.607118 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.607381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.607699 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.607942 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.608224 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.608470 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.608721 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.608962 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.609199 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.609444 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.609699 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.609699 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.610165 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.610405 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.610664 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.610920 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.611152 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.611394 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.611591 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.611693 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.611768 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.611856 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.611942 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.612012 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.612080 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.612155 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.612233 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.612312 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.612388 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.612457 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.612590 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.612670 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.612746 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.612831 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.612902 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.612969 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.613035 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.613110 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.613186 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.613364 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.613450 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.613519 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.613586 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.613660 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.613737 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.613821 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.613891 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.613965 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.614038 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.614127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.614206 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.614286 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.614355 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.614422 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.614497 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.614565 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.614649 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.614738 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.614814 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.614814 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.614947 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615024 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615091 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615157 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615286 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615358 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615438 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615535 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615619 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615688 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615761 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615837 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615913 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615981 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.615981 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.616099 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.616172 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.616240 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.616315 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.616383 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.616449 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.616516 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.616588 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.616588 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.616795 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.616869 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.616938 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617003 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617069 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617069 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617197 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617262 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617328 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617401 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617477 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617554 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617638 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617714 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617782 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617848 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617923 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.617991 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.618057 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.618122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.618187 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.618266 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.618341 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.618415 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.618514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.618584 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.618650 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.618716 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.618792 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.618860 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.618926 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.618998 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.619065 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.619144 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.619213 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.619279 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.619345 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.619410 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.619674 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.619780 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.619852 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.619920 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.620002 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.620079 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.620147 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.620226 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.620527 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.620620 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.620840 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.620929 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.621156 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.621256 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.621471 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.621569 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.621781 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.621878 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.622107 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.622198 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.622423 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.622519 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.622733 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.622866 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.623059 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.623152 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.623375 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.623463 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.623750 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.623851 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.624137 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.624244 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.624468 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.624557 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.624796 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.624893 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.625105 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.625201 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.625412 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.625500 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.625717 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.625820 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.626028 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.626118 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.626348 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.626438 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.626657 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.626755 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.626963 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.627059 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.627271 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.627359 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.627609 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.627703 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.627919 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.628007 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.628226 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.628325 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.628531 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.628619 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.628857 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.628952 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.629177 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.629264 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.629478 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.629577 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.629844 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.629939 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.630063 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.630154 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.630367 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.630456 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.630674 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.630762 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.630978 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.631079 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.631287 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.631382 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.631623 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.631721 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.631929 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.632071 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.632232 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.632320 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.632535 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.632623 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.632837 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.632936 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.633141 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.633279 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.633456 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.633545 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.633770 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.633866 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.634076 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.634154 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.634385 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.634472 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.634692 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.634772 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.635000 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.635078 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.635307 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.635398 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.635659 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.635844 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.635975 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.636192 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.636280 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.636518 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.636621 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.636871 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.636960 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.637192 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.637280 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.637513 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.637608 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.637826 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.637920 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.638135 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.638230 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.638450 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.638548 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.638775 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.638862 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.639092 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.639180 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.639397 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.639507 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.639753 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.639988 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.640093 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.640170 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.640372 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.640462 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.640690 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.640778 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.641004 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.641104 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.641368 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.641456 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.641684 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.641773 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.641998 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.642164 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.642317 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.642405 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.642627 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.642713 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.642941 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.643039 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.643261 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.643339 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.643605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.643701 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.643928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.644018 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.644256 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.644343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.645127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.645354 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.645465 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.645550 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.645838 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.645933 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.646136 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.646234 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.646453 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.646554 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.646775 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.646862 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.647112 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.647214 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.647433 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.647596 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.647773 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.647862 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.648083 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.648188 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.648330 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103644) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 16:24:43.648426 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.648767 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.649126 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.649445 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.649829 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.650134 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.650452 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.650774 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.651080 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:24:43.651327 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103645) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 16:24:43.806318 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO dbcounter [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] Registered counter for database nova_api Jun 30 16:24:43.810401 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO dbcounter [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] Registered counter for database nova_api Jun 30 16:24:43.829229 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG oslo_db.sqlalchemy.engines [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:24:43.834375 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:24:43.836999 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG dbcounter [-] [103644] Writer thread running {{(pid=103644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:24:43.841254 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writer thread running {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:24:43.895332 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.context [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),70849487-d146-4446-8c56-f6084f9b53dd(cell1) {{(pid=103644) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 16:24:43.899340 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG oslo_concurrency.lockutils [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:24:43.900462 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.context [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),70849487-d146-4446-8c56-f6084f9b53dd(cell1) {{(pid=103645) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 16:24:43.900977 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG oslo_concurrency.lockutils [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:24:43.901772 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG oslo_concurrency.lockutils [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:24:43.903763 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG oslo_concurrency.lockutils [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103644) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:24:43.904554 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:24:43.906053 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO dbcounter [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] Registered counter for database nova_cell0 Jun 30 16:24:43.906431 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:24:43.907260 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:24:43.909251 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:24:43.911849 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO dbcounter [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] Registered counter for database nova_cell1 Jun 30 16:24:43.912034 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO dbcounter [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] Registered counter for database nova_cell0 Jun 30 16:24:43.917947 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO dbcounter [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] Registered counter for database nova_cell1 Jun 30 16:24:43.923133 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG oslo_db.sqlalchemy.engines [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:24:43.924811 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG oslo_db.sqlalchemy.engines [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:24:43.925682 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:24:43.929065 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:24:43.933282 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG dbcounter [-] [103644] Writer thread running {{(pid=103644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:24:43.933820 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writer thread running {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:24:43.937244 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG dbcounter [-] [103644] Writer thread running {{(pid=103644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:24:43.939649 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writer thread running {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:24:44.085660 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO dbcounter [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] Registered counter for database nova_cell0 Jun 30 16:24:44.094787 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103645) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:24:44.099410 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writer thread running {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:24:44.115451 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO dbcounter [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] Registered counter for database nova_cell0 Jun 30 16:24:44.125390 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG oslo_db.sqlalchemy.engines [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103644) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:24:44.130467 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG dbcounter [-] [103644] Writer thread running {{(pid=103644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:24:44.551828 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: WARNING keystonemiddleware.auth_token [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 16:24:44.559390 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: WARNING keystonemiddleware.auth_token [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 16:24:44.569999 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: WARNING keystonemiddleware.auth_token [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 16:24:44.577415 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: WARNING keystonemiddleware.auth_token [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 16:24:44.907959 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: WARNING keystonemiddleware.auth_token [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 16:24:44.914505 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: WARNING keystonemiddleware.auth_token [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 16:24:44.919976 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a6c96cb9c0 pid: 103645 (default app) Jun 30 16:24:44.922112 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:24:44.923189 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: WARNING keystonemiddleware.auth_token [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 16:24:44.923333 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001794 Jun 30 16:24:44.923730 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Thu Jun 30 16:24:44 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:24:44.930068 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: WARNING keystonemiddleware.auth_token [None req-a199c800-627c-48f5-b759-11b60e41be8d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 16:24:44.935518 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a6c96cb9c0 pid: 103644 (default app) Jun 30 16:26:05.038620 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:05.040317 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002131 Jun 30 16:26:05.041130 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 2/2] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 30 16:26:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:26:05.054247 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG dbcounter [-] [103644] Writing DB stats nova_api:SELECT=3 {{(pid=103644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:26:05.055402 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG dbcounter [-] [103644] Writing DB stats nova_cell0:SELECT=3 {{(pid=103644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:26:05.056749 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG dbcounter [-] [103644] Writing DB stats nova_cell1:SELECT=3 {{(pid=103644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:26:05.057526 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG dbcounter [-] [103644] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:26:05.497756 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-171649cf-a13f-4a9f-9f22-90b79b2a1420 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:05.529490 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-171649cf-a13f-4a9f-9f22-90b79b2a1420 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.480951 Jun 30 16:26:05.530279 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 1/3] 10.222.0.67 () {60 vars in 1291 bytes} [Thu Jun 30 16:26:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:26:07.626080 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:07.628276 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-c2a7a39c-23b6-42b5-94ee-b7c85bdaaa7c None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002357 Jun 30 16:26:07.628838 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 3/4] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 30 16:26:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:26:07.693023 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-23244ea4-a903-4bfc-bb4f-9fa7bc717130 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "id": "c1", "name": "cirros256"}} {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:07.711444 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 16:26:07.711444 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: warnings.warn(msg) Jun 30 16:26:07.806974 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-23244ea4-a903-4bfc-bb4f-9fa7bc717130 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.171929 Jun 30 16:26:07.807848 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 2/5] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 30 16:26:07 2022] POST /compute/v2.1/flavors => generated 407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 16:26:07.822746 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_api:SELECT=3 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:26:07.824294 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_cell1:SELECT=3 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:26:07.825301 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_cell0:SELECT=3 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:26:07.827046 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:26:08.035590 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-d6530997-35bf-4b9d-934f-489dfb66a5c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:08.038027 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 16:26:08.038027 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: warnings.warn(msg) Jun 30 16:26:08.209171 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-d6530997-35bf-4b9d-934f-489dfb66a5c2 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.393082 Jun 30 16:26:08.209930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 4/6] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jun 30 16:26:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:26:10.347548 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-23244ea4-a903-4bfc-bb4f-9fa7bc717130 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:10.348600 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-23244ea4-a903-4bfc-bb4f-9fa7bc717130 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jun 30 16:26:10.349005 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 3/7] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 30 16:26:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:26:10.462115 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-26b1f25f-e89e-42e7-b18b-e05f5e184595 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 5, "rxtx_factor": 1.0, "ram": 512, "name": "ds512M", "id": "d1"}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:10.481040 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 16:26:10.481040 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: warnings.warn(msg) Jun 30 16:26:10.610400 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-26b1f25f-e89e-42e7-b18b-e05f5e184595 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.255442 Jun 30 16:26:10.611376 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 5/8] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 30 16:26:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:26:10.627544 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-bdd67e46-488e-4a91-af68-3d173ad753a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:10.629549 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 16:26:10.629549 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: warnings.warn(msg) Jun 30 16:26:10.737389 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-bdd67e46-488e-4a91-af68-3d173ad753a3 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114702 Jun 30 16:26:10.745346 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 4/9] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jun 30 16:26:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:26:12.857791 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-26b1f25f-e89e-42e7-b18b-e05f5e184595 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:12.858822 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-26b1f25f-e89e-42e7-b18b-e05f5e184595 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 30 16:26:12.859510 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 6/10] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 30 16:26:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:26:12.920987 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-79be2c5d-4b5d-4551-a152-a5de24ce8d8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "disk": 10, "swap": 0}} {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:13.038697 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-79be2c5d-4b5d-4551-a152-a5de24ce8d8c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.172110 Jun 30 16:26:13.039552 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 5/11] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 30 16:26:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 16:26:13.052582 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-227fabc6-2c32-4bc6-ab7a-a7ae9d4758c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:13.164403 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-227fabc6-2c32-4bc6-ab7a-a7ae9d4758c8 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116878 Jun 30 16:26:13.165733 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 7/12] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jun 30 16:26:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:26:15.313741 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-79be2c5d-4b5d-4551-a152-a5de24ce8d8c admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:15.314845 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-79be2c5d-4b5d-4551-a152-a5de24ce8d8c admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jun 30 16:26:15.315247 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 6/13] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 30 16:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:26:15.376075 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-f51d38bd-333b-47e4-8d38-063add395acb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "ram": 2048, "vcpus": 2, "swap": 0, "disk": 10}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:15.464750 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-f51d38bd-333b-47e4-8d38-063add395acb admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143431 Jun 30 16:26:15.466757 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 8/14] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 30 16:26:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:26:15.477876 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-1fdb61ee-4187-4552-8ae0-10c84ac88292 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:15.606321 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-1fdb61ee-4187-4552-8ae0-10c84ac88292 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132109 Jun 30 16:26:15.606915 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 7/15] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jun 30 16:26:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:26:17.758634 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-f51d38bd-333b-47e4-8d38-063add395acb admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:17.759667 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-f51d38bd-333b-47e4-8d38-063add395acb admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 30 16:26:17.760056 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 9/16] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 30 16:26:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:26:17.826278 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-0edd940b-caae-4ad6-ba37-2c19ae1c6616 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:17.909014 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-0edd940b-caae-4ad6-ba37-2c19ae1c6616 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142967 Jun 30 16:26:17.909625 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 8/17] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 30 16:26:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 16:26:17.921633 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-e4fa7441-ee2f-4ddf-a70f-242781b3c0c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:18.006093 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-e4fa7441-ee2f-4ddf-a70f-242781b3c0c4 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088029 Jun 30 16:26:18.006994 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 10/18] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jun 30 16:26:17 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:26:20.116450 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-0edd940b-caae-4ad6-ba37-2c19ae1c6616 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:20.117476 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-0edd940b-caae-4ad6-ba37-2c19ae1c6616 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 30 16:26:20.119377 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 9/19] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 30 16:26:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:26:20.177078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-fc44ce91-980b-48e7-97b2-abb5cf0f1774 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:20.200773 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-fc44ce91-980b-48e7-97b2-abb5cf0f1774 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076617 Jun 30 16:26:20.201327 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 11/20] 10.222.0.67 () {60 vars in 1291 bytes} [Thu Jun 30 16:26:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:26:22.461266 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-0edd940b-caae-4ad6-ba37-2c19ae1c6616 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:22.462346 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-0edd940b-caae-4ad6-ba37-2c19ae1c6616 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001609 Jun 30 16:26:22.462753 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 10/21] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 30 16:26:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:26:22.529703 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-89ad0f1a-1e3a-40ef-8adf-f1f5a955dbdd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "swap": 0, "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:22.617121 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-89ad0f1a-1e3a-40ef-8adf-f1f5a955dbdd admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.148207 Jun 30 16:26:22.617674 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 12/22] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 30 16:26:22 2022] POST /compute/v2.1/flavors => generated 402 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 16:26:22.630554 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-24ba2492-6bab-497f-a031-00a46be6c86c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:22.731288 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-24ba2492-6bab-497f-a031-00a46be6c86c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105094 Jun 30 16:26:22.731777 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 11/23] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jun 30 16:26:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:26:24.916425 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-89ad0f1a-1e3a-40ef-8adf-f1f5a955dbdd admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:24.917969 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-89ad0f1a-1e3a-40ef-8adf-f1f5a955dbdd admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002176 Jun 30 16:26:24.918574 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 30 16:26:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:26:24.985269 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-f3b6f0fc-4639-4984-abd8-7fb2b477bfec admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:25.063648 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-f3b6f0fc-4639-4984-abd8-7fb2b477bfec admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.135836 Jun 30 16:26:25.064611 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 12/25] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 30 16:26:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:26:25.080584 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-b0f56afa-1914-4890-9d93-53c3b4492b1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:25.166721 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-b0f56afa-1914-4890-9d93-53c3b4492b1e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091320 Jun 30 16:26:25.167285 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 14/26] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jun 30 16:26:25 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:26:27.266326 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-f3b6f0fc-4639-4984-abd8-7fb2b477bfec admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:27.267453 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-f3b6f0fc-4639-4984-abd8-7fb2b477bfec admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 Jun 30 16:26:27.267920 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 13/27] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 30 16:26:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:26:27.332701 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-9948a7bd-c585-4dbb-b942-90488ad44437 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "swap": 0}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:27.429339 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-9948a7bd-c585-4dbb-b942-90488ad44437 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.155495 Jun 30 16:26:27.429894 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 15/28] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 30 16:26:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:26:27.442848 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-b4bd778e-02d1-4d00-a61f-bb3797a23291 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:27.537979 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-b4bd778e-02d1-4d00-a61f-bb3797a23291 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099389 Jun 30 16:26:27.538750 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 14/29] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jun 30 16:26:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:26:29.634577 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-9948a7bd-c585-4dbb-b942-90488ad44437 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:29.635613 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-9948a7bd-c585-4dbb-b942-90488ad44437 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 30 16:26:29.636014 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 16/30] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 30 16:26:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:26:29.694871 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-e4693ff1-ae66-48cd-88c6-f70d18652dc3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:29.781598 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-e4693ff1-ae66-48cd-88c6-f70d18652dc3 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.139520 Jun 30 16:26:29.783033 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 15/31] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 30 16:26:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:26:29.795355 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-9d8b8c28-55ef-4a2a-8b4f-c337a6280461 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:29.885264 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-9d8b8c28-55ef-4a2a-8b4f-c337a6280461 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.093546 Jun 30 16:26:29.885932 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 17/32] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jun 30 16:26:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:26:32.025283 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-e4693ff1-ae66-48cd-88c6-f70d18652dc3 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:32.026287 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-e4693ff1-ae66-48cd-88c6-f70d18652dc3 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 30 16:26:32.026686 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 16/33] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 30 16:26:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:26:32.090994 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-e831677a-b00b-4f9e-b957-4e50e8740f76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "ram": 16384, "id": "5", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:32.169821 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-e831677a-b00b-4f9e-b957-4e50e8740f76 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.137138 Jun 30 16:26:32.170497 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 18/34] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 30 16:26:32 2022] POST /compute/v2.1/flavors => generated 408 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 16:26:32.183534 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-d1920cf1-e530-4b68-90c7-68f55974b188 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:26:32.281108 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-d1920cf1-e530-4b68-90c7-68f55974b188 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101140 Jun 30 16:26:32.281727 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 17/35] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jun 30 16:26:32 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:26:58.162690 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-e831677a-b00b-4f9e-b957-4e50e8740f76 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:58.163758 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-e831677a-b00b-4f9e-b957-4e50e8740f76 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 30 16:26:58.164157 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 19/36] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 30 16:26:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:26:58.175420 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG dbcounter [-] [103644] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:26:58.225114 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-4654fedd-290a-4432-8579-a219a0dc6495 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:58.242982 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-4654fedd-290a-4432-8579-a219a0dc6495 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072780 Jun 30 16:26:58.243543 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 18/37] 10.222.0.67 () {60 vars in 1291 bytes} [Thu Jun 30 16:26:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:26:59.192793 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-e831677a-b00b-4f9e-b957-4e50e8740f76 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:59.193808 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-e831677a-b00b-4f9e-b957-4e50e8740f76 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jun 30 16:26:59.194215 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 20/38] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 30 16:26:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:26:59.388414 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-6c3a75a3-fba7-4839-9bf7-e17695cbeda5 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:59.395216 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.wsgi [None req-6c3a75a3-fba7-4839-9bf7-e17695cbeda5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-6c3a75a3-fba7-4839-9bf7-e17695cbeda5 admin admin] Request method failure captured: Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Accept: application/json Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Accept-Encoding: gzip, deflate Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Connection: keep-alive Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Content-Length: 0 Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Host: 10.222.0.67 Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Openstack-Api-Version: compute 2.90 Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Openstack-System-Scope: None Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: User-Agent: python-novaclient Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Auth-Token: gAAAAABivc7TanfXTZqYJ_BfM_2wUj2HjZUjifeMsg1Vow2bUhHpBoC5l7tvorVwU8C-Rz1xdFa-T5LtpHJeoRBpJQ_isHYTdhg5E_LMuL8Ld4pE4V33kSiJBM7ZmslOOaaCQ7Pc9wFogvS6yOhSRiuh-38RJzWqnDGvVJhc0dNPssFuvnwwdp0 Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Domain-Id: None Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Domain-Name: None Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Identity-Status: Confirmed Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Is-Admin-Project: True Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Project-Domain-Id: default Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Project-Domain-Name: Default Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Project-Id: 3967c884c6b647c2a8e60d73c62e7927 Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Project-Name: admin Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Role: admin,reader,member Jun 30 16:26:59.398514 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Roles: admin,reader,member Jun 30 16:26:59.408115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3967c884c6b647c2a8e60d73c62e7927"}]}] Jun 30 16:26:59.408115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Tenant: admin Jun 30 16:26:59.408115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Tenant-Id: 3967c884c6b647c2a8e60d73c62e7927 Jun 30 16:26:59.408115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Tenant-Name: admin Jun 30 16:26:59.408115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User: admin Jun 30 16:26:59.408115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User-Domain-Id: default Jun 30 16:26:59.408115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User-Domain-Name: Default Jun 30 16:26:59.408115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User-Id: 9242c0a59f6b49568f911aaa0ef688f2 Jun 30 16:26:59.408115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User-Name: admin Jun 30 16:26:59.408115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: method: > Jun 30 16:26:59.408115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: exception: Flavor 42 could not be found. Jun 30 16:26:59.408115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: action_args: {'id': '42'} Jun 30 16:26:59.408115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:26:59.408115 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:26:59.409222 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:26:59.410590 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-6c3a75a3-fba7-4839-9bf7-e17695cbeda5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:26:59.411984 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-6c3a75a3-fba7-4839-9bf7-e17695cbeda5 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065540 Jun 30 16:26:59.411984 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 19/39] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Jun 30 16:26:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 16:26:59.412277 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-390d6c10-9200-4e54-abd9-3f063bb9d8cd admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:59.420278 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:26:59.431465 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-390d6c10-9200-4e54-abd9-3f063bb9d8cd admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025084 Jun 30 16:26:59.432074 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 21/40] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jun 30 16:26:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:26:59.443132 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-6998862a-e45d-4554-8e51-a3da6382f637 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:59.464807 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-6998862a-e45d-4554-8e51-a3da6382f637 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025353 Jun 30 16:26:59.465377 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 20/41] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jun 30 16:26:59 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:26:59.475848 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-e29ac4b4-85bb-4c31-8d32-092c0a27a995 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:26:59.481717 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.wsgi [None req-e29ac4b4-85bb-4c31-8d32-092c0a27a995 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-e29ac4b4-85bb-4c31-8d32-092c0a27a995 admin admin] Request method failure captured: Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Accept: application/json Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Accept-Encoding: gzip, deflate Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Connection: keep-alive Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Content-Length: 0 Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Host: 10.222.0.67 Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Openstack-Api-Version: compute 2.90 Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Openstack-System-Scope: None Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: User-Agent: python-novaclient Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Auth-Token: gAAAAABivc7TanfXTZqYJ_BfM_2wUj2HjZUjifeMsg1Vow2bUhHpBoC5l7tvorVwU8C-Rz1xdFa-T5LtpHJeoRBpJQ_isHYTdhg5E_LMuL8Ld4pE4V33kSiJBM7ZmslOOaaCQ7Pc9wFogvS6yOhSRiuh-38RJzWqnDGvVJhc0dNPssFuvnwwdp0 Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Domain-Id: None Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Domain-Name: None Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Identity-Status: Confirmed Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Is-Admin-Project: True Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Project-Domain-Id: default Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Project-Domain-Name: Default Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Project-Id: 3967c884c6b647c2a8e60d73c62e7927 Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Project-Name: admin Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Role: admin,reader,member Jun 30 16:26:59.486155 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Roles: admin,reader,member Jun 30 16:26:59.487946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3967c884c6b647c2a8e60d73c62e7927"}]}] Jun 30 16:26:59.487946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Tenant: admin Jun 30 16:26:59.487946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Tenant-Id: 3967c884c6b647c2a8e60d73c62e7927 Jun 30 16:26:59.487946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Tenant-Name: admin Jun 30 16:26:59.487946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User: admin Jun 30 16:26:59.487946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User-Domain-Id: default Jun 30 16:26:59.487946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User-Domain-Name: Default Jun 30 16:26:59.487946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User-Id: 9242c0a59f6b49568f911aaa0ef688f2 Jun 30 16:26:59.487946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User-Name: admin Jun 30 16:26:59.487946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: method: > Jun 30 16:26:59.487946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: exception: Flavor 42 could not be found. Jun 30 16:26:59.487946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: action_args: {'id': '42'} Jun 30 16:26:59.487946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:26:59.487946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:26:59.488930 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:26:59.490343 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-e29ac4b4-85bb-4c31-8d32-092c0a27a995 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:26:59.492157 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-e29ac4b4-85bb-4c31-8d32-092c0a27a995 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015381 Jun 30 16:26:59.492157 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 22/42] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Jun 30 16:26:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 16:27:00.325994 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-6998862a-e45d-4554-8e51-a3da6382f637 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:00.327015 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-6998862a-e45d-4554-8e51-a3da6382f637 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 30 16:27:00.327421 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 21/43] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 30 16:27:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:27:00.522830 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-8545153d-cddb-47ad-9d5b-110defc1f472 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:00.528864 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.wsgi [None req-8545153d-cddb-47ad-9d5b-110defc1f472 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-8545153d-cddb-47ad-9d5b-110defc1f472 admin admin] Request method failure captured: Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Accept: application/json Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Accept-Encoding: gzip, deflate Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Connection: keep-alive Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Content-Length: 0 Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Host: 10.222.0.67 Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Openstack-Api-Version: compute 2.90 Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Openstack-System-Scope: None Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: User-Agent: python-novaclient Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Auth-Token: gAAAAABivc7UQVGt6L9VYwAog8iD-bvxhc9UatTTl5NgNG9kyM7MzkFV37bMQ887xAdY-T_47h7AL7o8stSSkDtmbQ-iu9iHsO8-TUAKVYp6J-E9k85qChOg8HBgZGBbx1TbHPMW4SiVJIqIsx2MRMiCG7AB88BKNEtEmxZ1B3bNohG14uqDs6s Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Domain-Id: None Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Domain-Name: None Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Identity-Status: Confirmed Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Is-Admin-Project: True Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Project-Domain-Id: default Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Project-Domain-Name: Default Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Project-Id: 3967c884c6b647c2a8e60d73c62e7927 Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Project-Name: admin Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Role: admin,reader,member Jun 30 16:27:00.530381 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Roles: admin,reader,member Jun 30 16:27:00.532636 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3967c884c6b647c2a8e60d73c62e7927"}]}] Jun 30 16:27:00.532636 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Tenant: admin Jun 30 16:27:00.532636 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Tenant-Id: 3967c884c6b647c2a8e60d73c62e7927 Jun 30 16:27:00.532636 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Tenant-Name: admin Jun 30 16:27:00.532636 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User: admin Jun 30 16:27:00.532636 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User-Domain-Id: default Jun 30 16:27:00.532636 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User-Domain-Name: Default Jun 30 16:27:00.532636 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User-Id: 9242c0a59f6b49568f911aaa0ef688f2 Jun 30 16:27:00.532636 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User-Name: admin Jun 30 16:27:00.532636 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: method: > Jun 30 16:27:00.532636 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: exception: Flavor 84 could not be found. Jun 30 16:27:00.532636 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: action_args: {'id': '84'} Jun 30 16:27:00.532636 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:27:00.532636 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:27:00.533610 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:27:00.534928 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-8545153d-cddb-47ad-9d5b-110defc1f472 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:27:00.536281 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-8545153d-cddb-47ad-9d5b-110defc1f472 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064251 Jun 30 16:27:00.536281 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Jun 30 16:27:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 16:27:00.541568 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-5a646863-5752-4647-a570-2d565feed736 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:00.559399 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-5a646863-5752-4647-a570-2d565feed736 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021323 Jun 30 16:27:00.559998 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 22/45] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jun 30 16:27:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:27:00.570476 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-bb88f3d8-25bf-4fad-9826-25af233193ab admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:00.586158 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-bb88f3d8-25bf-4fad-9826-25af233193ab admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019125 Jun 30 16:27:00.587758 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jun 30 16:27:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:27:00.597126 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-0e652caa-2834-4ddf-801c-8313699b625e admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:00.603037 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.wsgi [None req-0e652caa-2834-4ddf-801c-8313699b625e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-0e652caa-2834-4ddf-801c-8313699b625e admin admin] Request method failure captured: Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Accept: application/json Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Accept-Encoding: gzip, deflate Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Connection: keep-alive Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Content-Length: 0 Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Host: 10.222.0.67 Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Openstack-Api-Version: compute 2.90 Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Openstack-System-Scope: None Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: User-Agent: python-novaclient Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Auth-Token: gAAAAABivc7UQVGt6L9VYwAog8iD-bvxhc9UatTTl5NgNG9kyM7MzkFV37bMQ887xAdY-T_47h7AL7o8stSSkDtmbQ-iu9iHsO8-TUAKVYp6J-E9k85qChOg8HBgZGBbx1TbHPMW4SiVJIqIsx2MRMiCG7AB88BKNEtEmxZ1B3bNohG14uqDs6s Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Domain-Id: None Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Domain-Name: None Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Identity-Status: Confirmed Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Is-Admin-Project: True Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Project-Domain-Id: default Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Project-Domain-Name: Default Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Project-Id: 3967c884c6b647c2a8e60d73c62e7927 Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Project-Name: admin Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Role: admin,reader,member Jun 30 16:27:00.604522 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Roles: admin,reader,member Jun 30 16:27:00.606127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3967c884c6b647c2a8e60d73c62e7927"}]}] Jun 30 16:27:00.606127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Tenant: admin Jun 30 16:27:00.606127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Tenant-Id: 3967c884c6b647c2a8e60d73c62e7927 Jun 30 16:27:00.606127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Tenant-Name: admin Jun 30 16:27:00.606127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User: admin Jun 30 16:27:00.606127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User-Domain-Id: default Jun 30 16:27:00.606127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User-Domain-Name: Default Jun 30 16:27:00.606127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User-Id: 9242c0a59f6b49568f911aaa0ef688f2 Jun 30 16:27:00.606127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User-Name: admin Jun 30 16:27:00.606127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: method: > Jun 30 16:27:00.606127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: exception: Flavor 84 could not be found. Jun 30 16:27:00.606127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: action_args: {'id': '84'} Jun 30 16:27:00.606127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:27:00.606127 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:27:00.607017 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:27:00.608142 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-0e652caa-2834-4ddf-801c-8313699b625e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:27:00.610022 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-0e652caa-2834-4ddf-801c-8313699b625e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012751 Jun 30 16:27:00.610022 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 23/47] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Jun 30 16:27:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 16:27:01.460691 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-bb88f3d8-25bf-4fad-9826-25af233193ab admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:01.461705 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-bb88f3d8-25bf-4fad-9826-25af233193ab admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 30 16:27:01.462100 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 25/48] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 30 16:27:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:27:01.654039 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-a46b6fbb-2f4e-48c5-9969-53d61ce5a87a admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:01.660293 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.wsgi [None req-a46b6fbb-2f4e-48c5-9969-53d61ce5a87a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-a46b6fbb-2f4e-48c5-9969-53d61ce5a87a admin admin] Request method failure captured: Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Accept: application/json Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Accept-Encoding: gzip, deflate Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Connection: keep-alive Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Content-Length: 0 Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Host: 10.222.0.67 Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Openstack-Api-Version: compute 2.90 Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Openstack-System-Scope: None Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: User-Agent: python-novaclient Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Auth-Token: gAAAAABivc7VpwIpbx3oeswaxA0QT671h5OHkWnGnlS77YfW00z553oka4X2eYjLGcCi8JHKpwbZ2F-ttu_XpPjVybrUVJWoTYri8zKL0IRP_fzU7LrnRXB9-_WHb9nBFd1GK-MbhOtaEqC7btmUUI0TXy3JzhNY1_oTtERTqDUEXFxyrxNaS8M Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Domain-Id: None Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Domain-Name: None Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Identity-Status: Confirmed Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Is-Admin-Project: True Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Project-Domain-Id: default Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Project-Domain-Name: Default Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Project-Id: 3967c884c6b647c2a8e60d73c62e7927 Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Project-Name: admin Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Role: admin,reader,member Jun 30 16:27:01.661809 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Roles: admin,reader,member Jun 30 16:27:01.666605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3967c884c6b647c2a8e60d73c62e7927"}]}] Jun 30 16:27:01.666605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Tenant: admin Jun 30 16:27:01.666605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Tenant-Id: 3967c884c6b647c2a8e60d73c62e7927 Jun 30 16:27:01.666605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-Tenant-Name: admin Jun 30 16:27:01.666605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User: admin Jun 30 16:27:01.666605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User-Domain-Id: default Jun 30 16:27:01.666605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User-Domain-Name: Default Jun 30 16:27:01.666605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User-Id: 9242c0a59f6b49568f911aaa0ef688f2 Jun 30 16:27:01.666605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: X-User-Name: admin Jun 30 16:27:01.666605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: method: > Jun 30 16:27:01.666605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: exception: Flavor 451 could not be found. Jun 30 16:27:01.666605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: action_args: {'id': '451'} Jun 30 16:27:01.666605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:27:01.666605 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:27:01.667401 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: ERROR nova.api.openstack.wsgi Jun 30 16:27:01.668714 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-a46b6fbb-2f4e-48c5-9969-53d61ce5a87a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103644) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:27:01.669750 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-a46b6fbb-2f4e-48c5-9969-53d61ce5a87a admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062898 Jun 30 16:27:01.669750 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 24/49] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jun 30 16:27:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 30 16:27:01.673033 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-9e60061a-0ee4-46c8-9fff-eecdaec71e44 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:01.688386 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-9e60061a-0ee4-46c8-9fff-eecdaec71e44 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019109 Jun 30 16:27:01.688922 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 26/50] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jun 30 16:27:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:27:01.698911 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-0a601366-5c0d-4f92-aab5-3dff18624b59 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:01.713048 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-0a601366-5c0d-4f92-aab5-3dff18624b59 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018160 Jun 30 16:27:01.713588 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 25/51] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jun 30 16:27:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:27:01.723552 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-35a5dc2a-6afc-4b2b-a407-94fedbce9f39 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:01.728981 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.wsgi [None req-35a5dc2a-6afc-4b2b-a407-94fedbce9f39 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-35a5dc2a-6afc-4b2b-a407-94fedbce9f39 admin admin] Request method failure captured: Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Accept: application/json Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Accept-Encoding: gzip, deflate Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Connection: keep-alive Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Content-Length: 0 Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Host: 10.222.0.67 Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Openstack-Api-Version: compute 2.90 Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Openstack-System-Scope: None Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: User-Agent: python-novaclient Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Auth-Token: gAAAAABivc7VpwIpbx3oeswaxA0QT671h5OHkWnGnlS77YfW00z553oka4X2eYjLGcCi8JHKpwbZ2F-ttu_XpPjVybrUVJWoTYri8zKL0IRP_fzU7LrnRXB9-_WHb9nBFd1GK-MbhOtaEqC7btmUUI0TXy3JzhNY1_oTtERTqDUEXFxyrxNaS8M Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Domain-Id: None Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Domain-Name: None Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Identity-Status: Confirmed Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Is-Admin-Project: True Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Openstack-Nova-Api-Version: 2.90 Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Project-Domain-Id: default Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Project-Domain-Name: Default Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Project-Id: 3967c884c6b647c2a8e60d73c62e7927 Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Project-Name: admin Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Role: admin,reader,member Jun 30 16:27:01.730477 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Roles: admin,reader,member Jun 30 16:27:01.732078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_3967c884c6b647c2a8e60d73c62e7927"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/3967c884c6b647c2a8e60d73c62e7927"}]}] Jun 30 16:27:01.732078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Tenant: admin Jun 30 16:27:01.732078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Tenant-Id: 3967c884c6b647c2a8e60d73c62e7927 Jun 30 16:27:01.732078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-Tenant-Name: admin Jun 30 16:27:01.732078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User: admin Jun 30 16:27:01.732078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User-Domain-Id: default Jun 30 16:27:01.732078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User-Domain-Name: Default Jun 30 16:27:01.732078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User-Id: 9242c0a59f6b49568f911aaa0ef688f2 Jun 30 16:27:01.732078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: X-User-Name: admin Jun 30 16:27:01.732078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: method: > Jun 30 16:27:01.732078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: exception: Flavor 451 could not be found. Jun 30 16:27:01.732078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: action_args: {'id': '451'} Jun 30 16:27:01.732078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:27:01.732078 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:27:01.733122 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: ERROR nova.api.openstack.wsgi Jun 30 16:27:01.734645 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-35a5dc2a-6afc-4b2b-a407-94fedbce9f39 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103645) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:27:01.735927 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-35a5dc2a-6afc-4b2b-a407-94fedbce9f39 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011831 Jun 30 16:27:01.735927 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 27/52] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jun 30 16:27:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 30 16:27:02.560270 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-0a601366-5c0d-4f92-aab5-3dff18624b59 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:02.561325 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-0a601366-5c0d-4f92-aab5-3dff18624b59 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jun 30 16:27:02.561761 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 26/53] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 30 16:27:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:27:02.753286 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-79c3ca1a-0651-4245-920f-dcaea211fb1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:27:02.817107 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-79c3ca1a-0651-4245-920f-dcaea211fb1f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.115858 Jun 30 16:27:02.817672 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 28/54] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Jun 30 16:27:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:27:03.668321 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-0a601366-5c0d-4f92-aab5-3dff18624b59 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:03.669364 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-0a601366-5c0d-4f92-aab5-3dff18624b59 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 30 16:27:03.669765 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 27/55] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 30 16:27:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:27:03.864893 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-996c085c-a152-42d5-94e4-217bc93c6776 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:27:03.942469 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-996c085c-a152-42d5-94e4-217bc93c6776 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.130347 Jun 30 16:27:03.943027 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 29/56] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Jun 30 16:27:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:27:04.779985 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-0a601366-5c0d-4f92-aab5-3dff18624b59 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:04.780999 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-0a601366-5c0d-4f92-aab5-3dff18624b59 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 30 16:27:04.781390 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 28/57] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 30 16:27:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:27:04.973910 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-51a58571-daa4-4c48-9948-63f4c3575e58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:27:05.076503 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-51a58571-daa4-4c48-9948-63f4c3575e58 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.156157 Jun 30 16:27:05.077051 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 30/58] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Jun 30 16:27:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:27:05.909154 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-0a601366-5c0d-4f92-aab5-3dff18624b59 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:05.910171 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-0a601366-5c0d-4f92-aab5-3dff18624b59 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 30 16:27:05.910577 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 29/59] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 30 16:27:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:27:06.104946 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-3b18104c-d5bd-4189-b394-6b5345459c39 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:27:06.212183 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-3b18104c-d5bd-4189-b394-6b5345459c39 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.160742 Jun 30 16:27:06.212733 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 31/60] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Jun 30 16:27:06 2022] POST /compute/v2.1/flavors => generated 409 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:27:07.050717 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-0a601366-5c0d-4f92-aab5-3dff18624b59 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:07.051786 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-0a601366-5c0d-4f92-aab5-3dff18624b59 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jun 30 16:27:07.052183 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 30/61] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 30 16:27:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:27:07.245787 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-2a6012b9-2474-46f4-821c-6f3e7045954b admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:07.266164 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-2a6012b9-2474-46f4-821c-6f3e7045954b admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073676 Jun 30 16:27:07.266751 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 32/62] 10.222.0.67 () {60 vars in 1202 bytes} [Thu Jun 30 16:27:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:27:55.060759 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-0a601366-5c0d-4f92-aab5-3dff18624b59 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:55.063724 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-0a601366-5c0d-4f92-aab5-3dff18624b59 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 30 16:27:55.063724 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 31/63] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 30 16:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:27:55.073263 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:27:55.125180 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-3508b4a1-9f93-4481-adad-69afbd140cf9 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:55.145554 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-3508b4a1-9f93-4481-adad-69afbd140cf9 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077005 Jun 30 16:27:55.151940 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 33/64] 10.222.0.67 () {60 vars in 1291 bytes} [Thu Jun 30 16:27:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:27:55.172440 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-1dff1a7e-24d3-4ee6-9f93-4e0b4d39afa3 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:55.176079 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG dbcounter [-] [103644] Writing DB stats nova_api:SELECT=14 {{(pid=103644) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:27:55.181630 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-1dff1a7e-24d3-4ee6-9f93-4e0b4d39afa3 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013402 Jun 30 16:27:55.190069 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 32/65] 10.222.0.67 () {60 vars in 1282 bytes} [Thu Jun 30 16:27:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:27:55.195536 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-115f0024-14ef-4860-ac07-e522e6a6736f admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:55.204254 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-115f0024-14ef-4860-ac07-e522e6a6736f admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012597 Jun 30 16:27:55.204825 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 34/66] 10.222.0.67 () {60 vars in 1285 bytes} [Thu Jun 30 16:27:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:27:55.217775 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-7358b77b-375f-454d-8b70-5e429e3f70f2 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:55.225983 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-7358b77b-375f-454d-8b70-5e429e3f70f2 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012567 Jun 30 16:27:55.226530 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 33/67] 10.222.0.67 () {60 vars in 1285 bytes} [Thu Jun 30 16:27:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:27:55.239116 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-9da4b07f-6ffc-4dba-b66a-cbdafa193d51 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:27:55.247491 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-9da4b07f-6ffc-4dba-b66a-cbdafa193d51 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012081 Jun 30 16:27:55.248049 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 35/68] 10.222.0.67 () {60 vars in 1282 bytes} [Thu Jun 30 16:27:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:31:35.362442 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-7358b77b-375f-454d-8b70-5e429e3f70f2 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:31:35.364656 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-7358b77b-375f-454d-8b70-5e429e3f70f2 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 30 16:31:35.364656 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 34/69] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 30 16:31:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:31:35.649954 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-fcab4b2f-3161-42ac-b222-1f933251bf73 admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:31:35.651219 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 16:31:35.651219 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: warnings.warn(msg) Jun 30 16:31:35.652767 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-fcab4b2f-3161-42ac-b222-1f933251bf73 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:31:35.653066 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-fcab4b2f-3161-42ac-b222-1f933251bf73 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:31:35.654024 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-fcab4b2f-3161-42ac-b222-1f933251bf73 admin admin] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:31:35.654491 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-fcab4b2f-3161-42ac-b222-1f933251bf73 admin admin] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:31:35.695812 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-fcab4b2f-3161-42ac-b222-1f933251bf73 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.186259 Jun 30 16:31:35.696409 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 36/70] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jun 30 16:31:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:31:36.676753 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-7358b77b-375f-454d-8b70-5e429e3f70f2 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:31:36.678617 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-7358b77b-375f-454d-8b70-5e429e3f70f2 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002951 Jun 30 16:31:36.679361 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 35/71] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 30 16:31:36 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:31:36.936990 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-6fad538a-f47e-422d-8b14-a77f4a4f08bb admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:31:36.938265 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 16:31:36.938265 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: warnings.warn(msg) Jun 30 16:31:36.940879 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-6fad538a-f47e-422d-8b14-a77f4a4f08bb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:31:36.941570 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-6fad538a-f47e-422d-8b14-a77f4a4f08bb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:31:36.942577 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-6fad538a-f47e-422d-8b14-a77f4a4f08bb admin admin] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:31:36.943208 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-6fad538a-f47e-422d-8b14-a77f4a4f08bb admin admin] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:31:36.968094 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-6fad538a-f47e-422d-8b14-a77f4a4f08bb admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.102780 Jun 30 16:31:36.968908 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 37/72] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jun 30 16:31:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:31:48.324273 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-7358b77b-375f-454d-8b70-5e429e3f70f2 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:31:48.325330 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-7358b77b-375f-454d-8b70-5e429e3f70f2 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 30 16:31:48.325707 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 36/73] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 30 16:31:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:31:48.473582 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_cell0:SELECT=4 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:31:48.474340 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_cell1:SELECT=4 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:31:48.474973 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG dbcounter [-] [103645] Writing DB stats nova_api:SELECT=14 {{(pid=103645) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:31:48.530388 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-70f15281-b5b5-4d26-a3e6-248c7c58748f admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:31:48.532086 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 16:31:48.532086 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: warnings.warn(msg) Jun 30 16:31:48.533509 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-70f15281-b5b5-4d26-a3e6-248c7c58748f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:31:48.534160 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-70f15281-b5b5-4d26-a3e6-248c7c58748f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:31:48.535026 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-70f15281-b5b5-4d26-a3e6-248c7c58748f admin admin] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:31:48.535512 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-70f15281-b5b5-4d26-a3e6-248c7c58748f admin admin] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:31:48.562890 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-70f15281-b5b5-4d26-a3e6-248c7c58748f admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.094334 Jun 30 16:31:48.563462 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 38/74] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jun 30 16:31:48 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:31:49.467252 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: DEBUG nova.api.openstack.wsgi [None req-7358b77b-375f-454d-8b70-5e429e3f70f2 admin admin] Calling method '>' {{(pid=103644) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:31:49.468471 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: INFO nova.api.openstack.requestlog [None req-7358b77b-375f-454d-8b70-5e429e3f70f2 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Jun 30 16:31:49.469051 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: [pid: 103644|app: 0|req: 37/75] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 30 16:31:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:31:49.680341 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG nova.api.openstack.wsgi [None req-632e1443-9c17-43ea-be95-62998839f0bb admin admin] Calling method '>' {{(pid=103645) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:31:49.681982 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 16:31:49.681982 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: warnings.warn(msg) Jun 30 16:31:49.683495 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-632e1443-9c17-43ea-be95-62998839f0bb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:31:49.689682 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-632e1443-9c17-43ea-be95-62998839f0bb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:31:49.689682 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-632e1443-9c17-43ea-be95-62998839f0bb admin admin] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:31:49.689682 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: DEBUG oslo_concurrency.lockutils [None req-632e1443-9c17-43ea-be95-62998839f0bb admin admin] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103645) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:31:49.711782 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: INFO nova.api.openstack.requestlog [None req-632e1443-9c17-43ea-be95-62998839f0bb admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.096644 Jun 30 16:31:49.712512 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: [pid: 103645|app: 0|req: 39/76] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jun 30 16:31:49 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:32:46.501139 dv-cinder-836027-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 30 16:32:46.501707 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: Thu Jun 30 16:32:46 2022 - graceful shutdown triggered... Jun 30 16:32:46.502153 dv-cinder-836027-2-iscsi devstack@n-api.service[103644]: Gracefully killing worker 1 (pid: 103644)... Jun 30 16:32:46.502616 dv-cinder-836027-2-iscsi devstack@n-api.service[103645]: Gracefully killing worker 2 (pid: 103645)... Jun 30 16:32:47.502871 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: worker 1 buried after 1 seconds Jun 30 16:32:47.502871 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: worker 2 buried after 1 seconds Jun 30 16:32:47.502871 dv-cinder-836027-2-iscsi devstack@n-api.service[103643]: goodbye to uWSGI. Jun 30 16:32:47.504527 dv-cinder-836027-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 30 16:32:47.505100 dv-cinder-836027-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 30 16:32:47.508046 dv-cinder-836027-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 30 16:32:47.521255 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 30 16:32:47.524089 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 16:32:47 2022] *** Jun 30 16:32:47.524089 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 16:32:47.524089 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 16:32:47.524089 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: nodename: dv-cinder-836027-2-iscsi Jun 30 16:32:47.524089 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: machine: x86_64 Jun 30 16:32:47.524089 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: clock source: unix Jun 30 16:32:47.524089 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: pcre jit disabled Jun 30 16:32:47.524089 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: detected number of CPU cores: 4 Jun 30 16:32:47.524089 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: current working directory: / Jun 30 16:32:47.524089 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: detected binary path: /usr/bin/uwsgi-core Jun 30 16:32:47.524089 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: your processes number limit is 47680 Jun 30 16:32:47.524089 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: your memory page size is 4096 bytes Jun 30 16:32:47.525265 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: detected max file descriptor number: 2048 Jun 30 16:32:47.525265 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: lock engine: pthread robust mutexes Jun 30 16:32:47.525265 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: thunder lock: enabled Jun 30 16:32:47.525265 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 30 16:32:47.525265 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 16:32:47.573268 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: Python main interpreter initialized at 0x5608a7a8a9c0 Jun 30 16:32:47.573268 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: python threads support enabled Jun 30 16:32:47.573268 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: your server socket listen backlog is limited to 100 connections Jun 30 16:32:47.573268 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: your mercy for graceful operations on workers is 90 seconds Jun 30 16:32:47.573994 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 16:32:47.573994 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: *** Operational MODE: preforking *** Jun 30 16:32:47.574174 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: *** uWSGI is running in multiple interpreter mode *** Jun 30 16:32:47.574174 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: spawned uWSGI master process (pid: 124799) Jun 30 16:32:47.574223 dv-cinder-836027-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 30 16:32:47.574845 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: spawned uWSGI worker 1 (pid: 124814, cores: 1) Jun 30 16:32:47.575406 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: spawned uWSGI worker 2 (pid: 124815, cores: 1) Jun 30 16:32:47.575762 dv-cinder-836027-2-iscsi devstack@n-api.service[124799]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 16:32:48.253543 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 16:32:48.254161 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 30 16:32:49.469262 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 16:32:49.469262 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: from cryptography.utils import int_from_bytes Jun 30 16:32:49.469919 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 16:32:49.469919 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: from cryptography.utils import int_from_bytes Jun 30 16:32:49.491248 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 16:32:49.491248 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: from cryptography.utils import int_from_bytes Jun 30 16:32:49.492025 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 16:32:49.492025 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: from cryptography.utils import int_from_bytes Jun 30 16:32:51.956799 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 16:32:51.957362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 16:32:51.957695 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 16:32:51.958060 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 16:32:51.958339 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 16:32:51.958763 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.959099 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.959434 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.959831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.960229 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.960552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.960884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.961222 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.961548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.961849 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.962200 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.962559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-2-iscsi {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.962955 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.963277 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.963622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.963962 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.964273 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.964604 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.964918 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.965427 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.969660 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.969660 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.969660 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.969660 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.969660 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.969660 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.970182 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.970182 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.970475 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.970685 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.971104 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-2-iscsi {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.971588 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.971910 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.972255 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.972695 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.973017 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.973426 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.973747 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.974079 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.974395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.974728 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.975055 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.975380 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.975732 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.976040 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.976356 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.976691 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.977019 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.977332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.977641 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.977899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.978222 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.978588 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.978920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.979248 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.979523 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.979783 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.980108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.980485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.980860 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.981178 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.981626 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.981843 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.982164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.983135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.983623 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.983953 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.984281 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.984607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.984938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.985254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.985581 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.986015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.986272 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.986591 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.986944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.987269 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.987625 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.987953 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.988306 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.988624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.988940 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.989255 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.989580 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.989958 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.990274 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.990546 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.990855 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.991170 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.991511 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.991899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.992394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.992877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.996775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.996775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.996775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.996775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.996775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.996775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.996775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.996775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.997500 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.997500 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.997500 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.997500 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.997500 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.997874 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.997874 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.998298 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.998566 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.998881 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.999175 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:51.999713 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.000028 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.000345 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.000673 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.000989 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.001322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.001658 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.001973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.002290 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.002615 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.002928 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.003242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.003600 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.004380 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.005116 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.005751 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.006246 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.006790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.007372 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.008241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.009896 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.010452 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.010979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.011611 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.012162 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.012817 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.013368 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.014074 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.014610 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.015168 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.015732 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.016820 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.017387 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.017730 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.018082 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.018669 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.019060 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.019596 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.019942 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.020283 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.020633 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.020983 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.021304 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.021637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.021966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.022298 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.022645 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.022983 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.023309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.023692 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.024050 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.024421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.024756 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.025093 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.025446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.025765 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.026086 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.026416 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.027144 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.027144 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.027428 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.027966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.028329 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.028653 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.028974 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.029885 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.030443 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.030788 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.031120 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.031447 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.031805 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.032130 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.032457 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.032778 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.033106 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.033422 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.033739 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.034060 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.034374 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.034708 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.035049 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.035367 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.035741 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.036060 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.036381 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.036701 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.037019 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.037334 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.037652 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.038106 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.038268 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.038596 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.038999 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.039538 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.040037 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.040514 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.040930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.041261 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.041584 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.041904 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.042261 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.042578 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.042927 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.043251 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.043749 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.044055 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.044399 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.044716 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.045986 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.046346 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.047087 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.047087 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.047403 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.047613 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.047932 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.048490 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.049069 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.049634 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.050214 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.050618 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.051062 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.051386 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.051649 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.052039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.052504 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.052714 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.053029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.053279 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.053577 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.053936 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.054289 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.054617 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.054954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.055316 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.055672 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.055999 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.056320 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.056638 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.056961 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.057295 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.057689 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.058081 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.058584 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.058766 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.059045 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.059376 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.059714 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.060039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.060390 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.060982 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.061910 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.061910 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.061910 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.062544 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.062544 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.062948 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.064742 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.064742 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.064742 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.064742 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.064742 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.065712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.065712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.066137 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.066137 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.066412 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.066710 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.067134 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.067500 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.067831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.068150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.068508 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.069061 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.069382 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.069540 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.069728 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.070044 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.070364 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.070686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.071099 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.071417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.072444 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.072444 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.072444 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.073454 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.073454 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.073865 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.075556 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.075556 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.075556 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.075556 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.075556 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.075556 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.076589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.076589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.076589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.077557 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.077557 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.077844 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.078088 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.078407 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.078861 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.079319 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.079746 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.079746 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.080039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.080333 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.080667 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.080989 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.081310 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.081628 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.082155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.082326 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.084286 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.084286 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.084286 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.084286 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.084286 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.084286 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.085976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.085976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.085976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.085976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.086526 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.086526 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.086902 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.087079 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.087396 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.087763 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.088123 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.088440 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.088977 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.089133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.089360 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.089933 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.090139 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.090298 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.090588 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.090909 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.091224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.092444 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.092897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.092897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.092897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.094016 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.094016 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.094577 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.094577 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.095010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.095162 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.095718 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.095718 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.096072 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.096386 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.096738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.097080 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.097424 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.097739 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.098053 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.098397 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.098693 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.099005 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.099317 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.099665 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.100805 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.100805 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.100805 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.101262 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.101262 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.101638 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.101809 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.102128 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.102441 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.102771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.103089 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.103401 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.103754 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.104069 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.104381 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.104689 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.105005 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.105312 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.105656 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.106029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.106240 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.106550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.106886 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.107182 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.108090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.109121 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.109121 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.109447 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.109652 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.109880 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.110123 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.110454 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.110774 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.111244 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.111411 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.111830 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.113222 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.113222 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.113222 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.113222 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.114157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.114157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.114157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.115042 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.115042 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.115042 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.115974 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.115974 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.115974 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.116665 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.116665 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.116982 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.117184 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.117556 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.117868 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.118192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.118524 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.118845 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.119165 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.119523 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.119831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.120157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.120479 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.120794 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.121397 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.121397 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.121753 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.122053 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.122362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.122702 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.123937 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.123937 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.124479 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.124479 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.124826 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.125230 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.125571 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.125788 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.126068 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.126568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.126745 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.127008 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.127330 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.127827 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.128003 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.128490 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.128835 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.129005 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.129259 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.129572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.130823 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.130823 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.130823 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.130823 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.132125 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.132125 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.132125 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.132745 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.132745 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.134208 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.134208 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.134208 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.134208 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.134208 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.135132 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.135132 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.135132 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.135975 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.135975 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.137388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.137388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.137388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.137388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.137388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.138272 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.138272 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.138272 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.138811 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.139263 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.139707 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.140788 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.140788 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.140788 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.141496 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.141496 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.142179 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.142179 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.142601 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.142837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.143067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.143888 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.143888 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.144369 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.144777 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.145026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.145259 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.145766 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.146127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.146345 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.146770 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.147191 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.147407 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.147695 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.148131 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.148307 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.148604 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.148919 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.149234 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.149574 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.149887 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.150210 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.150550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.150907 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.151174 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.151622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.151973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.153011 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.153011 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.153011 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.153521 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.153521 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.153865 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.154057 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.154973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.156362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.156362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.156362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.156362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.157404 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.157404 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.157404 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.158156 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.158156 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.158156 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.158799 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.158799 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.159103 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.159427 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.159785 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.160261 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.160712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.161057 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.161379 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.161692 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.162010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.162322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.163027 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.163027 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.163865 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.163865 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.164322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.164322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.164802 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.164802 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.165596 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.165596 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.165877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.166685 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.166685 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.168038 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.168038 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.168038 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.168038 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.168038 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.168852 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.168852 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.169159 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.169390 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.169716 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.170648 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.171700 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.171700 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.171700 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.172103 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.172517 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.172862 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.173189 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.173553 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.173939 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.174262 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.174592 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.174912 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.175231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.175577 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.175899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.176246 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.176575 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.176913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.177264 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.177590 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.177917 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.178239 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.178560 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.178937 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.179258 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.179602 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.179927 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.180255 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.180575 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.180892 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.181210 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.181531 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.181846 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.182162 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.182476 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.182875 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.183208 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.183575 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.183963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.184291 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.184612 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.184931 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.185256 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.185915 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.186245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.186596 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.186935 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.187270 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.187650 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.187983 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.188324 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.189163 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.189163 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.189378 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.189591 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.189943 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.190996 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.190996 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.190996 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.191518 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.191681 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.192169 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.192529 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.192860 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.193201 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.193656 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.193857 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.194171 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.194505 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.194742 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 16:32:52.195229 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.195394 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 16:32:52.195728 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.195728 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.196042 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 16:32:52.196188 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.196188 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.196478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 16:32:52.196478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 16:32:52.196785 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.196951 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.197107 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.197107 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.197381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.197584 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.197732 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.197885 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.198030 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.198175 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.198328 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.198485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.198639 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.198785 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.198945 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.199098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.199263 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.199416 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.199595 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.199749 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.199901 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.200053 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.200217 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.200376 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.200547 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-836027-2-iscsi {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.200702 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.200898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.201069 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.201260 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.201421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.201575 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.201735 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.201735 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.202041 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.202216 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.202543 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.202715 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.202886 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.203039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.203201 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.203362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.203548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.203752 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.203913 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.204076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.204229 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.204388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.204541 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.204716 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.204872 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.205106 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.205270 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.205430 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.205590 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.205742 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.205895 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.206060 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.206221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.206374 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.206537 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.206698 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.207006 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.207189 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.207352 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-836027-2-iscsi {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.207352 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.207723 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.207888 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.208050 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.208211 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.208371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.208523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.208683 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.208845 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.209017 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.209178 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.209338 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.209499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.209659 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.209833 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.209996 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.210156 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.210317 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.210470 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.210621 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.210787 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.210941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.211112 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.211273 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.211426 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.211620 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.211776 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.211928 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.212088 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.212241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.212402 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.212638 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.212813 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.212967 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.213138 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.213299 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.213452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.213614 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.213783 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.213936 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.214095 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.214256 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.214419 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.214572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.214732 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.214884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.215036 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.215204 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.215368 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.215368 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.215703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.215856 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.216009 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.216170 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.216331 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.216490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.216643 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.217404 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.217696 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.217915 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.218073 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.218225 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.218376 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.218529 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.218689 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.218855 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.219010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.219162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.219330 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.219582 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.219758 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.219933 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.220087 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.220238 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.220238 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.220525 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.220694 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.220854 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.221007 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.221158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.221318 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.221471 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.221637 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.221809 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.221971 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.222123 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.222275 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.222435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.222602 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.222764 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.222916 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.223068 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.223227 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.223397 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.223588 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.223588 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.223890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.224043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.224194 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.224356 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.224509 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.224661 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.224821 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.224974 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.225133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.225299 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.225452 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.225603 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.225763 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.225937 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.226089 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.226254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.226414 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.226566 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.226725 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.226885 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.227053 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.227206 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.227357 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.227529 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.227689 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.227867 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.228032 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.228185 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.228352 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.228505 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.228656 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.228815 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.228981 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.229142 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.229303 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.229497 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.229658 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.229809 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.229987 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.230148 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.230308 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.230468 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.230628 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.230794 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.230948 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.231100 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.231262 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.231429 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.231609 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.231781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.231934 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.232104 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.232266 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.232480 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.233185 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.233371 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.233526 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.233686 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.233854 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.234015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.234168 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.234332 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.234495 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.234648 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.234821 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.234984 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.235137 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.235291 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.235444 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.235705 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.235869 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.236022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.236181 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.236334 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.236493 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.236806 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.236988 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.237143 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.237304 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.237474 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.237627 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.237789 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.237943 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.238102 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.238262 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.238424 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.238576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.238737 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.238897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.239060 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.239212 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.239364 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.239554 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.239723 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.239884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.240037 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.240188 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.240348 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.240516 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.240669 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.240828 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.240982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.241247 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.241421 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.241591 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.241753 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.241906 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.242057 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.242217 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.242377 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.242551 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.242713 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 16:32:52.242875 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.243035 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.243200 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.243448 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.243643 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.243807 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.243966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.244118 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.244269 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.244434 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.244589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.244750 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.244902 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.245054 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.245204 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.245376 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.245536 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.245689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.245842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.246002 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.246164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.246317 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.246475 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.246626 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.246785 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.246944 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.247110 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.247274 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.247426 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.247669 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.247823 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.248014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.248189 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.248353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.248507 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.248658 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.248811 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.248972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.249134 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.249485 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.249662 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 16:32:52.249817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.249817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.249817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.249817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.249817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.249817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.249817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.249817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.250955 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.250955 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.250955 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.250955 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.250955 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.251701 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.251701 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.251701 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.252145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.252296 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.252557 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.252872 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.253186 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.253527 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.253841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.254161 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.254476 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.254879 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.255109 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.255424 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.255763 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.256074 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.256383 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.256692 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.257006 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.257313 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.257640 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.257975 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.258284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.258623 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.258934 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.259249 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.259587 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.259905 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.260219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.260535 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.260847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.261154 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.261482 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.261797 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.262105 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.262517 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.262741 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.263048 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.263365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.264273 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.264560 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.264862 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.265180 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.265506 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.265825 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.266142 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.266508 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.266844 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.267153 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.267508 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.267833 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.268153 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.268716 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.269027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.269336 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.269645 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.269952 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.270261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.270572 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.270881 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.271194 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.271521 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.271829 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.272155 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.272465 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.272773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.273078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.273383 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.273735 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.274038 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.274383 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.274719 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.275044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.275373 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.275713 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.276033 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.276361 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.276649 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.277387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.277387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.277843 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.277994 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.278186 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.278499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.278824 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.279138 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.280138 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.280539 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.280975 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.281565 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.281977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.282307 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.282643 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.282969 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.283296 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.283638 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.283956 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.284270 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.284590 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.284911 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.285225 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.285547 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.285859 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.286184 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.286498 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.286822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.287131 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.287448 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.287806 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.288142 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.288455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.288771 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.289098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.289415 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.289729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.290047 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.290358 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.290667 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.290981 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.291301 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.291641 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.291955 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.292264 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.292582 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.292893 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.293202 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.293511 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.293829 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.294158 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.294474 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.294798 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.295152 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.295461 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.295794 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.296120 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.296433 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.296743 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.297051 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.297359 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.297707 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.298024 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.298334 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.298716 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.299047 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.299363 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.299814 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.300071 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.300411 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.300722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.301041 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.301355 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.301671 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.301987 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.302301 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.302618 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.302945 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.303261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.303601 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.303920 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.304229 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.304544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.304868 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.305456 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.305796 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.306117 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.306442 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.306764 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.307118 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.307454 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.307808 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.308158 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.308471 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.308784 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.309094 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.309403 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.309718 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.310126 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.310372 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.310715 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.311073 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.311384 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.311724 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.312019 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.312265 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO dbcounter [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] Registered counter for database nova_api Jun 30 16:32:52.312655 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.312655 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.313180 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.313431 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.313696 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.313969 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.314236 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.314483 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.314744 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.315042 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.315389 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.315732 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.316080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.316413 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.316762 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.317071 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.317382 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.317707 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.318018 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.318326 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.318636 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.318949 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.319259 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.319602 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.319898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.320216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.320536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.320844 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.321154 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.321527 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.321765 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.322284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.322479 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.322706 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.322972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.323289 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.323623 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.323938 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.324250 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.324551 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.324872 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.325178 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.325484 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.325790 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.326630 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.326947 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.327257 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.327622 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.327950 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.328254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.328663 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.328977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.329285 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.329596 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.330062 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.330238 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.331009 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.331009 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.331365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.331561 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.331762 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.332067 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.332396 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.332692 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.333003 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.333308 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.333616 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.333929 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.334266 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.334579 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.334915 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.335118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_db.sqlalchemy.engines [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:32:52.335279 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.335514 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.335865 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.336175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.336546 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.336838 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.337163 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.337488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.337803 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.338107 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.338426 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.338735 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.339054 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.339369 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.339721 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.340024 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.340338 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.340660 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.340979 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.341294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.341622 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.342001 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.342338 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.342640 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.342812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writer thread running {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:32:52.342991 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.343261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.343599 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.343913 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.344219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.344536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.344834 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.345184 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.345503 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.345820 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.346133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.346450 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.346763 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.347072 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.347590 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.347851 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.348069 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.348331 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.348644 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.348960 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.349267 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.349720 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.350179 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.350459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.350724 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.350987 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.351258 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.351594 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.351921 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.352235 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.352663 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.352979 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.353297 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.353617 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.353928 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.354219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.354532 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.354869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.355175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.355587 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.355868 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.356133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.356397 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.356726 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.357150 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.358111 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.358876 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.359080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.359404 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.359751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.360084 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.360417 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.360750 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.361061 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.361391 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.361708 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.362037 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.362367 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.362685 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.363003 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.363318 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.363654 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.363987 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.364304 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.364630 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.365057 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.365383 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.365715 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.366025 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.366357 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.366668 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.366980 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.367294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.367627 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.367941 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.368274 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.368590 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.368897 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.369210 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.369527 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.369831 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.370141 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.370467 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.370780 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.371106 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.371428 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.371778 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.372105 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.372417 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.372744 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.373612 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.374151 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.374561 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.374868 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.375220 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.375556 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.375885 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.376223 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.376560 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.376875 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.377212 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.377543 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.377863 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.378185 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.378536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.378821 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.379129 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.379442 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.379775 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.380083 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.380390 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.380755 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.381066 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.381373 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.381684 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.382108 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.382361 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.382687 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.383085 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.383303 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.383627 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.383934 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.384284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.384651 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.384935 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.385261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.385589 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.385920 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.386231 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.386558 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.386879 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.387197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.387537 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.387860 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.388178 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.388495 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.388901 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.389323 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.389699 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.390024 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.390345 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.390922 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.391258 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.391605 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.391926 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.392246 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.392565 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.392883 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.393200 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.393771 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.394086 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.394401 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.394737 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.395064 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.395394 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.395934 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.396261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.396587 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.396911 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.397231 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.397596 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.397919 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.398232 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.398551 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.398958 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.399186 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.399525 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.399844 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.400162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.400482 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.400605 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.context [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),70849487-d146-4446-8c56-f6084f9b53dd(cell1) {{(pid=124815) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 16:32:52.400789 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.401099 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.401415 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.401735 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.402065 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.402404 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.402728 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.403047 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.403364 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.403710 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.404283 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.404602 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.404827 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:32:52.404988 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.405258 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.405586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.405907 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.406231 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.406431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:32:52.406565 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.406878 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.407190 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.407285 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:32:52.407533 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.407851 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.408161 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.408488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.408802 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.409119 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.409235 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:32:52.409462 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.409775 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.410317 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.410673 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.410995 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.411203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO dbcounter [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] Registered counter for database nova_cell0 Jun 30 16:32:52.411328 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.411695 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.412023 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.412333 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.412661 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.412971 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.413281 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.413698 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.414022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.414397 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.414642 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.414960 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.415274 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.415421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO dbcounter [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] Registered counter for database nova_cell1 Jun 30 16:32:52.415607 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.415925 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.416234 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.416566 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.416877 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.417186 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.417572 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.417893 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.418210 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.418569 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.418950 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.422393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.422393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.422393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.422393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.422393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.422393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.422393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.422393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.422985 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.422985 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.422985 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.423206 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.423369 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.423453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_db.sqlalchemy.engines [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:32:52.423812 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.424191 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.424353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.424828 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.425023 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.425557 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.425924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.426265 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.426581 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.427056 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.427254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.427594 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.427907 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.428219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.428551 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.428866 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.429182 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.429285 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writer thread running {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:32:52.429497 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.429812 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.429914 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_db.sqlalchemy.engines [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:32:52.430127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.430444 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.430756 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.431069 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.431383 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.431879 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.432041 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.432354 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.432672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.432990 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.433340 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.433667 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.433988 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.434308 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.434630 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.434944 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.435258 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.436448 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.436448 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.436760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.437097 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.437413 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.437726 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.438261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.438579 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.438902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.439227 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.439564 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.439896 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.440222 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.440539 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.440863 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.441179 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.441511 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.441860 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.442190 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.442525 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.442831 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.443140 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.443447 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.443786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.444112 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.444424 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.444728 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.445032 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.445345 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.445651 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.445958 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.447191 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.447191 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.447191 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.447191 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.447714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.447800 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.448058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.448364 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.448669 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.449121 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.449284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.449579 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.449884 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.450191 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.450496 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.450836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.451207 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.451549 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.451883 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.452202 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.452528 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.452890 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.453157 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.453467 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.453791 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.454107 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.454448 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.454764 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.455081 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.455398 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.455760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.456077 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.456425 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.456725 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.457111 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.457365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.457693 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.458016 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.458339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.458657 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.458980 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.459311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.459649 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.459964 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.460282 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.460596 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.460908 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.461227 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.461548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.461878 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.462206 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.462517 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.462844 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.463177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.463555 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.463876 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.464224 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.464551 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.464947 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.465269 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.465691 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 16:32:52.465852 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 16:32:52.530041 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO dbcounter [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] Registered counter for database nova_api Jun 30 16:32:52.558355 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_db.sqlalchemy.engines [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:32:52.566942 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writer thread running {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:32:52.579337 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writer thread running {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:32:52.589892 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO dbcounter [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] Registered counter for database nova_cell0 Jun 30 16:32:52.597444 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_db.sqlalchemy.engines [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:32:52.602769 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writer thread running {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:32:52.633397 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.context [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),70849487-d146-4446-8c56-f6084f9b53dd(cell1) {{(pid=124814) load_cells /opt/stack/nova/nova/context.py:464}} Jun 30 16:32:52.637562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:32:52.639847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:32:52.640618 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:32:52.642571 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:32:52.644869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO dbcounter [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] Registered counter for database nova_cell0 Jun 30 16:32:52.649608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO dbcounter [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] Registered counter for database nova_cell1 Jun 30 16:32:52.659225 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_db.sqlalchemy.engines [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:32:52.662225 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_db.sqlalchemy.engines [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:32:52.666674 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writer thread running {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:32:52.825550 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writer thread running {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:32:52.836721 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO dbcounter [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] Registered counter for database nova_cell0 Jun 30 16:32:52.847177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_db.sqlalchemy.engines [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 16:32:52.852484 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writer thread running {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 16:32:52.935726 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: WARNING keystonemiddleware.auth_token [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 16:32:52.943258 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: WARNING keystonemiddleware.auth_token [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 16:32:53.193501 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: WARNING keystonemiddleware.auth_token [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 16:32:53.201659 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: WARNING keystonemiddleware.auth_token [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 16:32:53.425311 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: WARNING keystonemiddleware.auth_token [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 16:32:53.438222 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: WARNING keystonemiddleware.auth_token [None req-a2c62c4e-ebe2-484b-9a1b-91cc0fdbac0f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 16:32:53.450108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608a7a8a9c0 pid: 124815 (default app) Jun 30 16:32:53.559194 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: WARNING keystonemiddleware.auth_token [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 30 16:32:53.565801 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: WARNING keystonemiddleware.auth_token [None req-8c79fa87-cbd2-432a-947c-78a79bc3c6c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 30 16:32:53.571239 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5608a7a8a9c0 pid: 124814 (default app) Jun 30 16:33:37.927133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=3 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:33:37.931935 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=3 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:33:37.933660 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=3 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:33:37.938522 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=3 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:33:39.720257 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1a257159-af10-4b3e-927c-b8d932d5f647 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Action: 'create', calling method: .version_select at 0x7f38219ca430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-233203689"}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:33:43.129713 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1a257159-af10-4b3e-927c-b8d932d5f647 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 5.237515 Jun 30 16:33:43.132451 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 1/1] 10.222.0.67 () {60 vars in 1154 bytes} [Thu Jun 30 16:33:37 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 5244 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 16:33:43.760562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d6a959fc-a9a9-4137-b2fd-31e4bea0e502 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f3821a7a4c0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:43.846416 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=3 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:33:43.850436 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=3 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:33:43.855532 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=3 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:33:43.856027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=3 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:33:44.281529 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d6a959fc-a9a9-4137-b2fd-31e4bea0e502 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c" status: 200 len: 345 microversion: 2.1 time: 1.130064 Jun 30 16:33:44.281876 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 1/2] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 30 16:33:43 2022] GET /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c => generated 345 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:33:44.287626 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-bc631ff8-539a-4b8a-ba49-01b554e9757e tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Action: 'create', calling method: .version_select at 0x7f3821892280>, body: {"snapshot": {"volume_id": "1f875b08-0e65-4f35-b36a-c2d286bbaa6c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-557911844"}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:33:45.243386 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-bc631ff8-539a-4b8a-ba49-01b554e9757e tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.960328 Jun 30 16:33:45.244762 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 2/3] 10.222.0.67 () {60 vars in 1161 bytes} [Thu Jun 30 16:33:44 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:33:45.259659 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-71dbeb13-bb44-47c6-ab18-cfc9ec7b7503 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f382188a550>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:45.450717 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-71dbeb13-bb44-47c6-ab18-cfc9ec7b7503 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699" status: 200 len: 286 microversion: 2.1 time: 0.198086 Jun 30 16:33:45.455543 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 30 16:33:45 2022] GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699 => generated 286 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:33:45.469669 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b8eeb49c-edd3-4e07-aaf2-f04221d61895 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f3821892310>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:46.152580 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b8eeb49c-edd3-4e07-aaf2-f04221d61895 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.691473 Jun 30 16:33:46.153717 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 3/5] 10.222.0.67 () {58 vars in 1139 bytes} [Thu Jun 30 16:33:45 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:33:46.164922 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2c457d0c-7dcf-4ea3-97dd-1747ab486885 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f382188a040>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:46.526414 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2c457d0c-7dcf-4ea3-97dd-1747ab486885 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699" status: 200 len: 286 microversion: 2.1 time: 0.366272 Jun 30 16:33:46.531908 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 3/6] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 30 16:33:46 2022] GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699 => generated 286 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:33:47.542732 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0b8fe361-aec1-4f12-9171-44b9d62707e8 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f38218a9040>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:47.622891 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-0b8fe361-aec1-4f12-9171-44b9d62707e8 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699" status: 200 len: 286 microversion: 2.1 time: 0.086329 Jun 30 16:33:47.628301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 30 16:33:47 2022] GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699 => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:33:48.637887 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3d80156d-097f-4ee5-8cea-12b3605c45ce tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f382188adc0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:48.728385 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3d80156d-097f-4ee5-8cea-12b3605c45ce tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699" status: 200 len: 286 microversion: 2.1 time: 0.096171 Jun 30 16:33:48.729224 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 30 16:33:48 2022] GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:33:49.742037 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c3fef27c-5b74-45f5-bc63-cc2063d74d38 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f38218a9790>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:49.942640 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c3fef27c-5b74-45f5-bc63-cc2063d74d38 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699" status: 200 len: 287 microversion: 2.1 time: 0.204408 Jun 30 16:33:49.947570 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 5/9] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 30 16:33:49 2022] GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699 => generated 287 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:33:49.966336 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a4057ad2-1c3c-4e6a-877f-81536ef0a21d tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f38218964c0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:50.536068 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-25837443", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "networks": [{"uuid": "6814a2cd-e579-4a71-a5f8-7331dec8330d"}]}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:33:50.747451 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a4057ad2-1c3c-4e6a-877f-81536ef0a21d tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699" status: 202 len: 0 microversion: 2.1 time: 0.786438 Jun 30 16:33:50.749392 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 5/10] 10.222.0.67 () {58 vars in 1253 bytes} [Thu Jun 30 16:33:49 2022] DELETE /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699 => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:33:50.757220 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f2afdd1f-c93f-4134-8019-4561fdda2007 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f382188adc0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:50.839885 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.network.neutron [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] validate_networks() for [('6814a2cd-e579-4a71-a5f8-7331dec8330d', None, None, None, None, None)] {{(pid=124815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:33:50.919614 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f2afdd1f-c93f-4134-8019-4561fdda2007 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699" status: 200 len: 286 microversion: 2.1 time: 0.166356 Jun 30 16:33:50.932036 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 6/11] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 30 16:33:50 2022] GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:33:51.942215 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7c1874a7-c9d7-4cc6-91d5-5cf70ba25637 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f382188a040>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:52.050960 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7c1874a7-c9d7-4cc6-91d5-5cf70ba25637 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699" status: 200 len: 286 microversion: 2.1 time: 0.112135 Jun 30 16:33:52.059131 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 7/12] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 30 16:33:51 2022] GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699 => generated 286 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:33:52.467205 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1864778325", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:33:52.654659 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.network.neutron [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] validate_networks() for [('aff5e7b4-b06a-4065-b396-531d28bbc09e', None, None, None, None, None)] {{(pid=124814) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:33:52.813915 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Flavor limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:33:52.814774 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Image limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:33:52.814899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Flavor pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:33:52.815246 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Image pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:33:52.815706 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:33:52.846897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:33:52.847632 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:33:52.848625 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:33:52.852762 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:33:52.953939 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Getting quotas for project 2da3dc7978d5414cba40e9e08dc39d94. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:33:52.975632 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Getting quotas for user 5703438f487a45abbc5b68b77519534c and project 2da3dc7978d5414cba40e9e08dc39d94. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:33:53.007251 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Going to run 1 instances... {{(pid=124815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:33:53.011695 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:33:53.333969 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c60c6b81-b5d3-4bf0-a0fe-c16afd56230e tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.935911 Jun 30 16:33:53.342350 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 6/13] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:33:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2944 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 16:33:53.365196 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d3857f63-02ca-4d0a-96c1-ed40a2d0ec3e tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f38217a4ee0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:53.470392 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d3857f63-02ca-4d0a-96c1-ed40a2d0ec3e tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699" status: 200 len: 286 microversion: 2.1 time: 0.123778 Jun 30 16:33:53.475019 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 7/14] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 30 16:33:53 2022] GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:33:53.477539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-464f30b8-a255-4883-bb03-bde9cf7ad0d4 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:53.478181 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-464f30b8-a255-4883-bb03-bde9cf7ad0d4 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:33:53.786094 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-464f30b8-a255-4883-bb03-bde9cf7ad0d4 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:33:53.836295 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-464f30b8-a255-4883-bb03-bde9cf7ad0d4 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1213 microversion: 2.1 time: 0.363217 Jun 30 16:33:53.836974 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 8/15] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:33:53 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1213 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:33:54.050258 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Flavor limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:33:54.054357 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Image limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:33:54.055216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Flavor pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:33:54.055998 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Image pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:33:54.056693 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:33:54.111586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:33:54.130295 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:33:54.130295 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:33:54.130295 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:33:54.248922 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Getting quotas for project 839a189179c543c6a704a968170ec022. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:33:54.282864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Getting quotas for user 2de23770f4374decb95ff94f3e7f793b and project 839a189179c543c6a704a968170ec022. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:33:54.315989 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Going to run 1 instances... {{(pid=124814) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:33:54.329124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:33:54.493102 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4642989e-838b-4de0-887d-d76dd80f3831 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f38207385e0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:54.553389 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-4642989e-838b-4de0-887d-d76dd80f3831 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] HTTP exception thrown: Snapshot a7bb169e-d785-4b62-a807-23798784d699 could not be found. Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4642989e-838b-4de0-887d-d76dd80f3831 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Request method failure captured: Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699 HTTP/1.1 Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdBhIMIZTOCBs9yD5MRgfet4sbPLO8EDA-3FO-nj6Ck0vfyrdE7RsSZDCS0eJPSg-wg4VwcTnAbwvi5ISE6b0MN0lInNiOIleXLybtSj9kPaoBSEdjJAjLXYUs7z76VR-0Fv49TbRCt-IhIAkBM2PuUDNjjv8JxsgXPwIcHrry_CS_c Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: aff9cc8cb38d45b1abfbafd1b1c4d30c Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-662914944 Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:33:54.561083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:33:54.562293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}] Jun 30 16:33:54.562293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-VolumesSnapshotsTestJSON-662914944 Jun 30 16:33:54.562293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: aff9cc8cb38d45b1abfbafd1b1c4d30c Jun 30 16:33:54.562293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-662914944 Jun 30 16:33:54.562293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-VolumesSnapshotsTestJSON-662914944-project Jun 30 16:33:54.562293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:33:54.562293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:33:54.562293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: f657742a762044b5a1ba8621069ca8b8 Jun 30 16:33:54.562293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-VolumesSnapshotsTestJSON-662914944-project Jun 30 16:33:54.562293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: Jun 30 16:33:54.562293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Snapshot a7bb169e-d785-4b62-a807-23798784d699 could not be found. Jun 30 16:33:54.562293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'a7bb169e-d785-4b62-a807-23798784d699'} Jun 30 16:33:54.562293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a7bb169e-d785-4b62-a807-23798784d699 could not be found. (HTTP 404) (Request-ID: req-9b346639-70db-4b71-b124-d874a43f010a) Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:54.562920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:33:54.564015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a7bb169e-d785-4b62-a807-23798784d699 could not be found. Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 30 16:33:54.565133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:33:54.566070 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a7bb169e-d785-4b62-a807-23798784d699 could not be found. Jun 30 16:33:54.566070 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:54.566070 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:33:54.566070 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:54.566070 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:54.566070 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:33:54.566070 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:33:54.566070 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:33:54.566070 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:33:54.566070 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a7bb169e-d785-4b62-a807-23798784d699 could not be found. Jun 30 16:33:54.566070 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:54.584147 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4642989e-838b-4de0-887d-d76dd80f3831 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Returning 404 to user: Snapshot a7bb169e-d785-4b62-a807-23798784d699 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:33:54.585230 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-4642989e-838b-4de0-887d-d76dd80f3831 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699" status: 404 len: 111 microversion: 2.1 time: 0.104305 Jun 30 16:33:54.590523 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 9/16] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 30 16:33:54 2022] GET /compute/v2.1/os-snapshots/a7bb169e-d785-4b62-a807-23798784d699 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 16:33:54.601971 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-3083758c-7bb5-4f96-abb1-2bc2e4467d75 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f38206c04c0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:54.677690 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a6b076e5-a3bf-409a-b99b-de29788d39f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.322717 Jun 30 16:33:54.693113 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 8/17] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:33:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 16:33:54.737864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-16341d9e-8022-4b98-ab60-34ab0c06b2ad tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:54.753195 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-16341d9e-8022-4b98-ab60-34ab0c06b2ad tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:33:54.961595 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-3083758c-7bb5-4f96-abb1-2bc2e4467d75 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c" status: 202 len: 0 microversion: 2.1 time: 0.364001 Jun 30 16:33:54.962872 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 10/18] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 30 16:33:54 2022] DELETE /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 16:33:54.970494 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2c447db6-95f6-4580-9337-76bdc7f050d5 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:54.971358 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2c447db6-95f6-4580-9337-76bdc7f050d5 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:33:54.989219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-16341d9e-8022-4b98-ab60-34ab0c06b2ad tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:33:55.037163 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-16341d9e-8022-4b98-ab60-34ab0c06b2ad tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1222 microversion: 2.1 time: 0.340466 Jun 30 16:33:55.053480 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 9/19] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:33:54 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1222 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:33:55.067611 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1209af6f-46e6-4f9e-8795-7660effc075a tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f3820fb1e50>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:55.157271 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2c447db6-95f6-4580-9337-76bdc7f050d5 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:33:55.168084 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2c447db6-95f6-4580-9337-76bdc7f050d5 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1213 microversion: 2.1 time: 0.202370 Jun 30 16:33:55.168922 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 11/20] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:33:54 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1213 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:33:55.247337 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-1209af6f-46e6-4f9e-8795-7660effc075a tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c" status: 200 len: 344 microversion: 2.1 time: 0.185979 Jun 30 16:33:55.248456 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 10/21] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 30 16:33:55 2022] GET /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c => generated 344 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:33:55.265402 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-276055201", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:33:55.379896 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9f90ca93-aa7b-4cc1-b07a-7b49be4580d8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Action: 'create', calling method: .version_select at 0x7f38206c0dc0>, body: {"keypair": {"name": "tempest-keypair-1900934417", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGiZPwwVe6d5HRa+jamq0RifruBQ4p5kNgWWI+022HH9mft+17nX/Z3Stl4L2JepfmvdwCAw/TXeYSaQJnIglHnG2mLrBynZsfJQ8UXN1Mb5WSQ4Mx2xP7dFvZrRmvYzvw=="}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:33:55.403632 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.network.neutron [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] validate_networks() for [('aff5e7b4-b06a-4065-b396-531d28bbc09e', None, None, None, None, None)] {{(pid=124814) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:33:55.471007 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-9f90ca93-aa7b-4cc1-b07a-7b49be4580d8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'key_pairs'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:33:55.482602 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-9f90ca93-aa7b-4cc1-b07a-7b49be4580d8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for user 0a26028451b345968fe86774f44736dd and project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'key_pairs'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:33:55.710049 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9f90ca93-aa7b-4cc1-b07a-7b49be4580d8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.537363 Jun 30 16:33:55.710049 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 12/22] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 30 16:33:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:33:56.194089 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-229c371b-2211-4673-b4d9-e5d88b35cf0c tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:56.195405 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-229c371b-2211-4673-b4d9-e5d88b35cf0c tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:33:56.486434 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-229c371b-2211-4673-b4d9-e5d88b35cf0c tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:33:56.496818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-229c371b-2211-4673-b4d9-e5d88b35cf0c tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1213 microversion: 2.1 time: 0.307476 Jun 30 16:33:56.503696 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 13/23] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:33:56 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1213 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:33:56.513528 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-46129185-3777-4ecf-a037-966718dd756c tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f38206e51f0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:56.653111 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-46129185-3777-4ecf-a037-966718dd756c tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c" status: 200 len: 344 microversion: 2.1 time: 0.152906 Jun 30 16:33:56.653962 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 14/24] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 30 16:33:56 2022] GET /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c => generated 344 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:33:56.822313 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Flavor limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:33:56.823232 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Image limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:33:56.824335 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Flavor pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:33:56.825525 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Image pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:33:56.826440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:33:56.849552 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:33:56.850846 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:33:56.864492 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:33:56.873214 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:33:56.942105 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Getting quotas for project 839a189179c543c6a704a968170ec022. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:33:56.949538 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Getting quotas for user 2de23770f4374decb95ff94f3e7f793b and project 839a189179c543c6a704a968170ec022. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:33:57.040026 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Going to run 1 instances... {{(pid=124814) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:33:57.054526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:33:57.347266 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8cdde67e-93c3-4e31-8c64-33a3083dd355 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.095299 Jun 30 16:33:57.362460 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 11/25] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:33:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 2113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 16:33:57.376086 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-984bc184-97f0-484d-af67-e6e8f593ad56 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:57.378343 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-984bc184-97f0-484d-af67-e6e8f593ad56 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:33:57.476353 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-984bc184-97f0-484d-af67-e6e8f593ad56 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:33:57.484153 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-984bc184-97f0-484d-af67-e6e8f593ad56 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1221 microversion: 2.1 time: 0.111983 Jun 30 16:33:57.498789 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 15/26] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:33:57 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:33:57.519764 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-78fad2ce-017b-471a-916d-abf452e3e2e6 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:57.520391 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-78fad2ce-017b-471a-916d-abf452e3e2e6 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:33:57.538768 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-78fad2ce-017b-471a-916d-abf452e3e2e6 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:33:57.543537 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-78fad2ce-017b-471a-916d-abf452e3e2e6 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:33:57.545836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-78fad2ce-017b-471a-916d-abf452e3e2e6 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:33:57.546372 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-78fad2ce-017b-471a-916d-abf452e3e2e6 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:33:57.667966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-39f69801-f85b-4de5-96f5-8bf3587696e8 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f38206e5430>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:57.904711 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-39f69801-f85b-4de5-96f5-8bf3587696e8 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] HTTP exception thrown: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-39f69801-f85b-4de5-96f5-8bf3587696e8 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Request method failure captured: Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c HTTP/1.1 Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdBhIMIZTOCBs9yD5MRgfet4sbPLO8EDA-3FO-nj6Ck0vfyrdE7RsSZDCS0eJPSg-wg4VwcTnAbwvi5ISE6b0MN0lInNiOIleXLybtSj9kPaoBSEdjJAjLXYUs7z76VR-0Fv49TbRCt-IhIAkBM2PuUDNjjv8JxsgXPwIcHrry_CS_c Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: aff9cc8cb38d45b1abfbafd1b1c4d30c Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-662914944 Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:33:57.930362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:33:57.932164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}] Jun 30 16:33:57.932164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-VolumesSnapshotsTestJSON-662914944 Jun 30 16:33:57.932164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: aff9cc8cb38d45b1abfbafd1b1c4d30c Jun 30 16:33:57.932164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-662914944 Jun 30 16:33:57.932164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-VolumesSnapshotsTestJSON-662914944-project Jun 30 16:33:57.932164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:33:57.932164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:33:57.932164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: f657742a762044b5a1ba8621069ca8b8 Jun 30 16:33:57.932164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-VolumesSnapshotsTestJSON-662914944-project Jun 30 16:33:57.932164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: Jun 30 16:33:57.932164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:57.932164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': '1f875b08-0e65-4f35-b36a-c2d286bbaa6c'} Jun 30 16:33:57.932164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. (HTTP 404) (Request-ID: req-65916185-56e7-4771-bef4-16193abfd3a9) Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:33:57.933067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:33:57.934464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 16:33:57.935421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:33:57.952431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:57.952431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:57.952431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:33:57.952431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:57.952431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:57.952431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:33:57.952431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:33:57.952431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:33:57.952431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:33:57.952431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:57.952431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:57.952431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-39f69801-f85b-4de5-96f5-8bf3587696e8 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Returning 404 to user: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:33:57.952431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-39f69801-f85b-4de5-96f5-8bf3587696e8 tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c" status: 404 len: 109 microversion: 2.1 time: 0.281270 Jun 30 16:33:57.952431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 16/27] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 30 16:33:57 2022] GET /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c => generated 109 bytes in 285 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:33:57.972330 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-58a5f075-803c-4ad2-b3bf-881a96daa2bc tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f38206c73a0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:58.074795 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-78fad2ce-017b-471a-916d-abf452e3e2e6 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:33:58.119017 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-78fad2ce-017b-471a-916d-abf452e3e2e6 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1217 microversion: 2.1 time: 0.590409 Jun 30 16:33:58.119017 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 12/28] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:33:57 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1217 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:33:58.225333 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-58a5f075-803c-4ad2-b3bf-881a96daa2bc tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] HTTP exception thrown: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-58a5f075-803c-4ad2-b3bf-881a96daa2bc tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Request method failure captured: Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: DELETE /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c HTTP/1.1 Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdBhIMIZTOCBs9yD5MRgfet4sbPLO8EDA-3FO-nj6Ck0vfyrdE7RsSZDCS0eJPSg-wg4VwcTnAbwvi5ISE6b0MN0lInNiOIleXLybtSj9kPaoBSEdjJAjLXYUs7z76VR-0Fv49TbRCt-IhIAkBM2PuUDNjjv8JxsgXPwIcHrry_CS_c Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: aff9cc8cb38d45b1abfbafd1b1c4d30c Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-662914944 Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:33:58.227694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:33:58.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}] Jun 30 16:33:58.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-VolumesSnapshotsTestJSON-662914944 Jun 30 16:33:58.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: aff9cc8cb38d45b1abfbafd1b1c4d30c Jun 30 16:33:58.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-662914944 Jun 30 16:33:58.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-VolumesSnapshotsTestJSON-662914944-project Jun 30 16:33:58.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:33:58.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:33:58.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: f657742a762044b5a1ba8621069ca8b8 Jun 30 16:33:58.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-VolumesSnapshotsTestJSON-662914944-project Jun 30 16:33:58.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: Jun 30 16:33:58.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:58.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': '1f875b08-0e65-4f35-b36a-c2d286bbaa6c'} Jun 30 16:33:58.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. (HTTP 404) (Request-ID: req-fe575b78-9ac7-48bc-9a2d-1503667de747) Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:33:58.230558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 16:33:58.231837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 16:33:58.233118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:33:58.234550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:58.234550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:58.234550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:33:58.234550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:58.234550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:58.234550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:33:58.234550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:33:58.234550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:33:58.234550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:33:58.234550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:58.234550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:33:58.234550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-58a5f075-803c-4ad2-b3bf-881a96daa2bc tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Returning 404 to user: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:33:58.234550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-58a5f075-803c-4ad2-b3bf-881a96daa2bc tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c" status: 404 len: 109 microversion: 2.1 time: 0.269151 Jun 30 16:33:58.234550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 17/29] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 30 16:33:57 2022] DELETE /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c => generated 109 bytes in 275 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:33:58.256473 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d3fe81d4-e15b-4bd3-8e4f-0a4c756414bb tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Calling method '.version_select at 0x7f38206e03a0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:58.450465 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-d3fe81d4-e15b-4bd3-8e4f-0a4c756414bb tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] HTTP exception thrown: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d3fe81d4-e15b-4bd3-8e4f-0a4c756414bb tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Request method failure captured: Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c HTTP/1.1 Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdBhIMIZTOCBs9yD5MRgfet4sbPLO8EDA-3FO-nj6Ck0vfyrdE7RsSZDCS0eJPSg-wg4VwcTnAbwvi5ISE6b0MN0lInNiOIleXLybtSj9kPaoBSEdjJAjLXYUs7z76VR-0Fv49TbRCt-IhIAkBM2PuUDNjjv8JxsgXPwIcHrry_CS_c Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: aff9cc8cb38d45b1abfbafd1b1c4d30c Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-662914944 Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:33:58.456098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:33:58.457254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/aff9cc8cb38d45b1abfbafd1b1c4d30c"}]}] Jun 30 16:33:58.457254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-VolumesSnapshotsTestJSON-662914944 Jun 30 16:33:58.457254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: aff9cc8cb38d45b1abfbafd1b1c4d30c Jun 30 16:33:58.457254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-662914944 Jun 30 16:33:58.457254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-VolumesSnapshotsTestJSON-662914944-project Jun 30 16:33:58.457254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:33:58.457254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:33:58.457254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: f657742a762044b5a1ba8621069ca8b8 Jun 30 16:33:58.457254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-VolumesSnapshotsTestJSON-662914944-project Jun 30 16:33:58.457254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: Jun 30 16:33:58.457254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:58.457254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': '1f875b08-0e65-4f35-b36a-c2d286bbaa6c'} Jun 30 16:33:58.457254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. (HTTP 404) (Request-ID: req-c0726c2c-8567-4453-b435-a71cee5a9b58) Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:33:58.457902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:33:58.458781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 16:33:58.459816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:33:58.460826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:58.460826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:33:58.460826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:33:58.460826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:33:58.460826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:33:58.460826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:33:58.460826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:33:58.460826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:33:58.460826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:33:58.460826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. Jun 30 16:33:58.460826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:33:58.460826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d3fe81d4-e15b-4bd3-8e4f-0a4c756414bb tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] Returning 404 to user: Volume 1f875b08-0e65-4f35-b36a-c2d286bbaa6c could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:33:58.460826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d3fe81d4-e15b-4bd3-8e4f-0a4c756414bb tempest-VolumesSnapshotsTestJSON-662914944 tempest-VolumesSnapshotsTestJSON-662914944-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c" status: 404 len: 109 microversion: 2.1 time: 0.220391 Jun 30 16:33:58.465081 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 13/30] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 30 16:33:58 2022] GET /compute/v2.1/os-volumes/1f875b08-0e65-4f35-b36a-c2d286bbaa6c => generated 109 bytes in 229 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:33:58.502183 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2625a25a-9b28-47a5-af75-63dcf7fd5c26 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:58.502950 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2625a25a-9b28-47a5-af75-63dcf7fd5c26 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:33:58.817180 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2625a25a-9b28-47a5-af75-63dcf7fd5c26 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:33:58.839501 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2625a25a-9b28-47a5-af75-63dcf7fd5c26 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1221 microversion: 2.1 time: 0.330788 Jun 30 16:33:58.840788 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 18/31] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:33:58 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1221 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:33:59.128260 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-612d8c42-b8ad-4ffa-a16e-1355e97708b2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:59.129686 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-612d8c42-b8ad-4ffa-a16e-1355e97708b2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:33:59.154187 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-612d8c42-b8ad-4ffa-a16e-1355e97708b2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:33:59.158426 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-612d8c42-b8ad-4ffa-a16e-1355e97708b2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:33:59.159633 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-612d8c42-b8ad-4ffa-a16e-1355e97708b2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:33:59.167584 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-612d8c42-b8ad-4ffa-a16e-1355e97708b2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:33:59.544079 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-612d8c42-b8ad-4ffa-a16e-1355e97708b2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:33:59.581863 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-612d8c42-b8ad-4ffa-a16e-1355e97708b2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1265 microversion: 2.1 time: 0.456697 Jun 30 16:33:59.612649 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 14/32] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:33:59 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1265 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:33:59.858773 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a86cddd1-4c72-4aac-95fd-1bfe35c6cd9d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:33:59.861054 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a86cddd1-4c72-4aac-95fd-1bfe35c6cd9d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:33:59.891883 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a86cddd1-4c72-4aac-95fd-1bfe35c6cd9d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:33:59.892818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a86cddd1-4c72-4aac-95fd-1bfe35c6cd9d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:33:59.899117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a86cddd1-4c72-4aac-95fd-1bfe35c6cd9d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:33:59.899921 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a86cddd1-4c72-4aac-95fd-1bfe35c6cd9d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:00.601041 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9e15f17d-e055-4b3e-95f4-788905d023e5 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:00.601774 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9e15f17d-e055-4b3e-95f4-788905d023e5 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:00.614275 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9e15f17d-e055-4b3e-95f4-788905d023e5 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:00.615382 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9e15f17d-e055-4b3e-95f4-788905d023e5 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:00.616924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9e15f17d-e055-4b3e-95f4-788905d023e5 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:00.617375 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9e15f17d-e055-4b3e-95f4-788905d023e5 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:00.871266 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9e15f17d-e055-4b3e-95f4-788905d023e5 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:00.894425 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9e15f17d-e055-4b3e-95f4-788905d023e5 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1271 microversion: 2.1 time: 0.298005 Jun 30 16:34:00.902541 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 15/33] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:00 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1271 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:00.904315 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a86cddd1-4c72-4aac-95fd-1bfe35c6cd9d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:00.928428 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a86cddd1-4c72-4aac-95fd-1bfe35c6cd9d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1217 microversion: 2.1 time: 1.074796 Jun 30 16:34:00.931614 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 19/34] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:33:59 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1217 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:01.298318 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-b750e5ad-8597-4862-870b-9de944ad45e1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Action: 'create', calling method: .version_select at 0x7f3820601310>, body: {"keypair": {"name": "tempest-keypair-2119489249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFM3p8yyg0gKQxzeWmlDpSfkxbZSNVHrFVaEdcpBUjoblzM6g8w1VHDCDQ/XDCZYDSuOL4oe1cUfjSuIvRgpV/Htw+YX85MI+6UEVCC+S7izKYIgC45Y/WlNkqKSbicLHQ=="}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:01.358228 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-b750e5ad-8597-4862-870b-9de944ad45e1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Getting quotas for project 80a9bf240ed0447faaf33bec8f19cb70. Resources: {'key_pairs'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:34:01.370218 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-b750e5ad-8597-4862-870b-9de944ad45e1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Getting quotas for user 18f2856b1d3742a1aca89b4aeec0a3bd and project 80a9bf240ed0447faaf33bec8f19cb70. Resources: {'key_pairs'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:34:01.579056 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-b750e5ad-8597-4862-870b-9de944ad45e1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.675074 Jun 30 16:34:01.585137 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 16/35] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 30 16:34:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:34:01.918889 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-62aa7fa8-48a3-43b7-9570-9d7998117fc8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:01.921885 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-62aa7fa8-48a3-43b7-9570-9d7998117fc8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:01.950413 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9658a6ab-3249-4383-8de4-96bbd71a502f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:01.959684 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9658a6ab-3249-4383-8de4-96bbd71a502f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:01.966468 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-62aa7fa8-48a3-43b7-9570-9d7998117fc8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:01.977792 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-62aa7fa8-48a3-43b7-9570-9d7998117fc8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:01.987156 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-62aa7fa8-48a3-43b7-9570-9d7998117fc8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:01.990903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-62aa7fa8-48a3-43b7-9570-9d7998117fc8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:01.993320 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9658a6ab-3249-4383-8de4-96bbd71a502f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:02.000118 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9658a6ab-3249-4383-8de4-96bbd71a502f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:02.001578 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9658a6ab-3249-4383-8de4-96bbd71a502f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:02.004454 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9658a6ab-3249-4383-8de4-96bbd71a502f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:02.515115 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-62aa7fa8-48a3-43b7-9570-9d7998117fc8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:02.533405 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-62aa7fa8-48a3-43b7-9570-9d7998117fc8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1271 microversion: 2.1 time: 0.618608 Jun 30 16:34:02.541907 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 20/36] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:01 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1271 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:02.579086 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9658a6ab-3249-4383-8de4-96bbd71a502f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:02.595068 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9658a6ab-3249-4383-8de4-96bbd71a502f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1291 microversion: 2.1 time: 0.649920 Jun 30 16:34:02.599037 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 17/37] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:01 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1291 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:02.885606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:02.951266 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-98b563c8-efa6-4cc3-96ce-181cb96a930e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Action: 'create', calling method: .version_select at 0x7f3820629670>, body: {"keypair": {"name": "tempest-keypair-2011843947", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaHLnGrntxaIzkh0A7QUQb03inM1TvVGRwp71MDqJRZnWND5JLIDKCoXRI5JGSSI+RgLx1CPeH2/adSWWRuIFBeK56aY0fprcnsQzedGL+vg8R51EW7XZgLJkWdN57Bgg=="}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:02.986825 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-98b563c8-efa6-4cc3-96ce-181cb96a930e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Getting quotas for project b66c389f8c5a47b2b97819e449c64ba0. Resources: {'key_pairs'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:34:03.008178 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-98b563c8-efa6-4cc3-96ce-181cb96a930e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Getting quotas for user 7261ab46436e4546b8331aa8387cfa1c and project b66c389f8c5a47b2b97819e449c64ba0. Resources: {'key_pairs'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:34:03.169696 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-98b563c8-efa6-4cc3-96ce-181cb96a930e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.383739 Jun 30 16:34:03.170665 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 21/38] 10.222.0.67 () {62 vars in 1199 bytes} [Thu Jun 30 16:34:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 385 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 16:34:03.558627 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-aa510284-5ffc-498f-be15-f09508804865 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:03.559238 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-aa510284-5ffc-498f-be15-f09508804865 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:03.566717 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-aa510284-5ffc-498f-be15-f09508804865 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:03.567066 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-aa510284-5ffc-498f-be15-f09508804865 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:03.567978 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-aa510284-5ffc-498f-be15-f09508804865 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:03.568429 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-aa510284-5ffc-498f-be15-f09508804865 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:03.621401 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8b3bc8fc-f3b0-4ff1-855e-bd33807dc90c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:03.627679 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8b3bc8fc-f3b0-4ff1-855e-bd33807dc90c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:03.651021 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8b3bc8fc-f3b0-4ff1-855e-bd33807dc90c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:03.674717 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8b3bc8fc-f3b0-4ff1-855e-bd33807dc90c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:03.674717 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8b3bc8fc-f3b0-4ff1-855e-bd33807dc90c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:03.674717 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8b3bc8fc-f3b0-4ff1-855e-bd33807dc90c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:03.818251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-aa510284-5ffc-498f-be15-f09508804865 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:03.833174 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-aa510284-5ffc-498f-be15-f09508804865 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1271 microversion: 2.1 time: 0.275298 Jun 30 16:34:03.834426 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 18/39] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:03 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1271 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:03.905080 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8b3bc8fc-f3b0-4ff1-855e-bd33807dc90c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:03.916893 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8b3bc8fc-f3b0-4ff1-855e-bd33807dc90c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1279 microversion: 2.1 time: 0.303771 Jun 30 16:34:03.928511 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 22/40] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:03 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1279 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:04.884135 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-822d3fbe-4c81-4e88-8f78-d56eeabff317 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:04.891309 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-822d3fbe-4c81-4e88-8f78-d56eeabff317 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:04.923541 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-822d3fbe-4c81-4e88-8f78-d56eeabff317 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:04.924433 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-822d3fbe-4c81-4e88-8f78-d56eeabff317 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:04.926875 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-822d3fbe-4c81-4e88-8f78-d56eeabff317 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:04.927712 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-822d3fbe-4c81-4e88-8f78-d56eeabff317 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:04.955069 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2b5e5f4e-b82d-40e8-9d98-0552767864be tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:04.956459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2b5e5f4e-b82d-40e8-9d98-0552767864be tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:05.009750 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2b5e5f4e-b82d-40e8-9d98-0552767864be tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:05.024388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2b5e5f4e-b82d-40e8-9d98-0552767864be tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:05.025580 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2b5e5f4e-b82d-40e8-9d98-0552767864be tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:05.026200 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2b5e5f4e-b82d-40e8-9d98-0552767864be tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:05.380343 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2b5e5f4e-b82d-40e8-9d98-0552767864be tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:05.402037 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2b5e5f4e-b82d-40e8-9d98-0552767864be tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1279 microversion: 2.1 time: 0.453211 Jun 30 16:34:05.418316 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 23/41] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:04 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1279 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:06.419637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4df23ad2-5fb5-461b-9050-2a282aeaf3b0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:06.424692 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4df23ad2-5fb5-461b-9050-2a282aeaf3b0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:06.469532 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4df23ad2-5fb5-461b-9050-2a282aeaf3b0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:06.473875 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4df23ad2-5fb5-461b-9050-2a282aeaf3b0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:06.506605 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4df23ad2-5fb5-461b-9050-2a282aeaf3b0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:06.511210 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4df23ad2-5fb5-461b-9050-2a282aeaf3b0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:06.895168 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=4 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:07.212111 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-822d3fbe-4c81-4e88-8f78-d56eeabff317 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:07.237549 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-822d3fbe-4c81-4e88-8f78-d56eeabff317 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 2.366111 Jun 30 16:34:07.250563 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 19/42] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:04 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 2382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:07.879588 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-4df23ad2-5fb5-461b-9050-2a282aeaf3b0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:07.901059 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-4df23ad2-5fb5-461b-9050-2a282aeaf3b0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 1.486490 Jun 30 16:34:07.911338 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 24/43] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:06 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:08.257256 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1e9bedc9-cc30-4e11-ab4a-c1e1bf9593c3 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:08.257953 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-1e9bedc9-cc30-4e11-ab4a-c1e1bf9593c3 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:08.279839 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1e9bedc9-cc30-4e11-ab4a-c1e1bf9593c3 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:08.280361 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1e9bedc9-cc30-4e11-ab4a-c1e1bf9593c3 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:08.286021 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1e9bedc9-cc30-4e11-ab4a-c1e1bf9593c3 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:08.286410 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1e9bedc9-cc30-4e11-ab4a-c1e1bf9593c3 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:08.807838 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1161702027", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16892394-e408-48ab-985b-412d1c45e5c5"}], "security_groups": [{"name": "tempest-securitygroup--119836791"}], "key_name": "tempest-keypair-1900934417", "user_data": "}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:08.936675 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-1e9bedc9-cc30-4e11-ab4a-c1e1bf9593c3 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:08.966618 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-1e9bedc9-cc30-4e11-ab4a-c1e1bf9593c3 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 0.714944 Jun 30 16:34:08.977456 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 20/44] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:08 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:08.986927 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-98602184-51b0-4867-9329-c14092bdbc65 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:08.986927 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-98602184-51b0-4867-9329-c14092bdbc65 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:09.058223 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-98602184-51b0-4867-9329-c14092bdbc65 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:09.058751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-98602184-51b0-4867-9329-c14092bdbc65 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:09.059570 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-98602184-51b0-4867-9329-c14092bdbc65 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:09.065860 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-98602184-51b0-4867-9329-c14092bdbc65 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:09.094523 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.network.neutron [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] validate_networks() for [('16892394-e408-48ab-985b-412d1c45e5c5', None, None, None, None, None)] {{(pid=124815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:34:10.808040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-98602184-51b0-4867-9329-c14092bdbc65 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:10.820408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-98602184-51b0-4867-9329-c14092bdbc65 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 1.840466 Jun 30 16:34:10.831959 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 21/45] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:08 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:10.893332 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-acd2badb-8bba-414a-98b4-52099c0a2235 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:10.899700 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-acd2badb-8bba-414a-98b4-52099c0a2235 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:10.917907 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-acd2badb-8bba-414a-98b4-52099c0a2235 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:10.920743 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-acd2badb-8bba-414a-98b4-52099c0a2235 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:10.926007 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-acd2badb-8bba-414a-98b4-52099c0a2235 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:10.928386 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-acd2badb-8bba-414a-98b4-52099c0a2235 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:11.405854 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=18 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:11.700111 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-acd2badb-8bba-414a-98b4-52099c0a2235 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:11.720805 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-acd2badb-8bba-414a-98b4-52099c0a2235 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 0.887407 Jun 30 16:34:11.735500 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 22/46] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:10 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:11.838504 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-06b88c5d-674d-4050-939e-92b3629dc0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:11.839172 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-06b88c5d-674d-4050-939e-92b3629dc0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:11.867052 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-06b88c5d-674d-4050-939e-92b3629dc0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:11.867052 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-06b88c5d-674d-4050-939e-92b3629dc0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:11.867052 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-06b88c5d-674d-4050-939e-92b3629dc0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:11.867052 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-06b88c5d-674d-4050-939e-92b3629dc0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:12.427180 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Flavor limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:34:12.427786 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Image limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:34:12.428193 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Flavor pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:34:12.428631 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Image pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:34:12.429204 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:34:12.456541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:12.457548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:12.458734 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:12.463798 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:12.527027 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:34:12.534775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for user 0a26028451b345968fe86774f44736dd and project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:34:12.569078 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Going to run 1 instances... {{(pid=124815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:34:12.576729 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:34:12.789199 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-cf92e152-73eb-4af9-a69b-0d20d3e12a63 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.983586 Jun 30 16:34:12.799075 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 25/47] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:34:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 3993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 16:34:13.094066 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-e99002ad-c53c-4e85-8a78-081e001f6d48 req-00356f59-a9b6-4cdf-b4d9-e94459a5fe4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37aac043-7017-417e-a8dd-0a2619c5f38b", "tag": "c270e4fc-eb23-4881-be9d-da7f4f37912e"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:13.133603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-e99002ad-c53c-4e85-8a78-081e001f6d48 req-00356f59-a9b6-4cdf-b4d9-e94459a5fe4c service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:13.141531 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-e99002ad-c53c-4e85-8a78-081e001f6d48 req-00356f59-a9b6-4cdf-b4d9-e94459a5fe4c service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:13.189337 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-e99002ad-c53c-4e85-8a78-081e001f6d48 req-00356f59-a9b6-4cdf-b4d9-e94459a5fe4c service nova] Creating event network-changed:c270e4fc-eb23-4881-be9d-da7f4f37912e for instance 37aac043-7017-417e-a8dd-0a2619c5f38b on hv-cinder-83602 Jun 30 16:34:13.191277 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-e99002ad-c53c-4e85-8a78-081e001f6d48 req-00356f59-a9b6-4cdf-b4d9-e94459a5fe4c service nova] Acquired lock "compute-rpcapi-router" {{(pid=124815) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 16:34:13.193939 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-02547910-fbee-42b3-8a33-d2b9b1efc4ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:13.195385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-02547910-fbee-42b3-8a33-d2b9b1efc4ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:13.197545 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-02547910-fbee-42b3-8a33-d2b9b1efc4ea None None] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:13.199602 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-02547910-fbee-42b3-8a33-d2b9b1efc4ea None None] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:13.222827 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.compute.rpcapi [None req-02547910-fbee-42b3-8a33-d2b9b1efc4ea None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 16:34:13.224294 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-02547910-fbee-42b3-8a33-d2b9b1efc4ea None None] Releasing lock "compute-rpcapi-router" {{(pid=124815) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 16:34:13.264775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-02547910-fbee-42b3-8a33-d2b9b1efc4ea None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.462599 Jun 30 16:34:13.266042 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 26/48] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:34:13.278041 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1fbb0567-592e-44a9-bf08-40ff88f86f6d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:13.278795 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1fbb0567-592e-44a9-bf08-40ff88f86f6d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:13.303631 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1fbb0567-592e-44a9-bf08-40ff88f86f6d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:13.311212 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1fbb0567-592e-44a9-bf08-40ff88f86f6d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:13.311212 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1fbb0567-592e-44a9-bf08-40ff88f86f6d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:13.311212 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1fbb0567-592e-44a9-bf08-40ff88f86f6d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:14.090647 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-06b88c5d-674d-4050-939e-92b3629dc0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:14.103621 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-06b88c5d-674d-4050-939e-92b3629dc0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 2.268705 Jun 30 16:34:14.108972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 23/49] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:11 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:14.134377 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ebea9564-9b79-4efa-b3fd-9d5f64f85ef4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:14.137088 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ebea9564-9b79-4efa-b3fd-9d5f64f85ef4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:14.695041 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ebea9564-9b79-4efa-b3fd-9d5f64f85ef4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:14.729362 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ebea9564-9b79-4efa-b3fd-9d5f64f85ef4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1242 microversion: 2.1 time: 0.616854 Jun 30 16:34:14.731063 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 24/50] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:14 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1242 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:14.849816 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1fbb0567-592e-44a9-bf08-40ff88f86f6d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:14.889815 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-20d0196d-dc25-47cb-9563-d396a20e0df0 req-54d17b84-85e6-4ec8-9ce0-69c073ac3893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ce60666-aa28-4c5d-b893-faa7f10a777b", "tag": "8d6b84f1-0b05-4d2b-8419-4c63e8ef22b1"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:14.904294 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1fbb0567-592e-44a9-bf08-40ff88f86f6d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 1.636667 Jun 30 16:34:14.905288 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 27/51] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:13 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:14.949934 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-20d0196d-dc25-47cb-9563-d396a20e0df0 req-54d17b84-85e6-4ec8-9ce0-69c073ac3893 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:14.950386 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-20d0196d-dc25-47cb-9563-d396a20e0df0 req-54d17b84-85e6-4ec8-9ce0-69c073ac3893 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:14.989574 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-20d0196d-dc25-47cb-9563-d396a20e0df0 req-54d17b84-85e6-4ec8-9ce0-69c073ac3893 service nova] Creating event network-changed:8d6b84f1-0b05-4d2b-8419-4c63e8ef22b1 for instance 6ce60666-aa28-4c5d-b893-faa7f10a777b on hv-cinder-83602 Jun 30 16:34:14.990267 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-20d0196d-dc25-47cb-9563-d396a20e0df0 req-54d17b84-85e6-4ec8-9ce0-69c073ac3893 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124814) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 30 16:34:14.991963 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-772d06aa-bfe0-44d5-9ed2-5dbc409a8d6f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:14.992472 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-772d06aa-bfe0-44d5-9ed2-5dbc409a8d6f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:15.011601 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-772d06aa-bfe0-44d5-9ed2-5dbc409a8d6f None None] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:15.014036 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-772d06aa-bfe0-44d5-9ed2-5dbc409a8d6f None None] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:15.034393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.compute.rpcapi [None req-772d06aa-bfe0-44d5-9ed2-5dbc409a8d6f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 30 16:34:15.035596 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-772d06aa-bfe0-44d5-9ed2-5dbc409a8d6f None None] Releasing lock "compute-rpcapi-router" {{(pid=124814) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 30 16:34:15.110210 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-772d06aa-bfe0-44d5-9ed2-5dbc409a8d6f None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.368299 Jun 30 16:34:15.114502 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 25/52] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:34:15.123739 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9571321c-b958-4201-8bc9-c9bade4203e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:15.124384 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9571321c-b958-4201-8bc9-c9bade4203e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:15.144708 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9571321c-b958-4201-8bc9-c9bade4203e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:15.144708 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9571321c-b958-4201-8bc9-c9bade4203e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:15.144708 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9571321c-b958-4201-8bc9-c9bade4203e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:15.144708 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9571321c-b958-4201-8bc9-c9bade4203e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:15.384925 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-c39b62ac-54eb-47eb-bc57-8d7f3837cd76 req-e799393a-5ed0-4cba-a842-11ff29896178 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cc16fc2-454c-4941-8709-fc424d36d88c", "tag": "b34f2ec4-8c64-4f05-98bb-ea3f485cf825"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:15.398612 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=7 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:15.419152 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-c39b62ac-54eb-47eb-bc57-8d7f3837cd76 req-e799393a-5ed0-4cba-a842-11ff29896178 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:15.424249 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-c39b62ac-54eb-47eb-bc57-8d7f3837cd76 req-e799393a-5ed0-4cba-a842-11ff29896178 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:15.439672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=69 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:15.474401 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-c39b62ac-54eb-47eb-bc57-8d7f3837cd76 req-e799393a-5ed0-4cba-a842-11ff29896178 service nova] Creating event network-changed:b34f2ec4-8c64-4f05-98bb-ea3f485cf825 for instance 1cc16fc2-454c-4941-8709-fc424d36d88c on hv-cinder-83602 Jun 30 16:34:15.489845 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-c39b62ac-54eb-47eb-bc57-8d7f3837cd76 req-e799393a-5ed0-4cba-a842-11ff29896178 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111840 Jun 30 16:34:15.491959 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 26/53] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:34:15.752873 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c1535990-1f3a-4035-b96f-8c9bb5542d16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:15.754501 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c1535990-1f3a-4035-b96f-8c9bb5542d16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:15.769158 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c1535990-1f3a-4035-b96f-8c9bb5542d16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:15.770605 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c1535990-1f3a-4035-b96f-8c9bb5542d16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:15.771862 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c1535990-1f3a-4035-b96f-8c9bb5542d16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:15.774056 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c1535990-1f3a-4035-b96f-8c9bb5542d16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:16.152106 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c1535990-1f3a-4035-b96f-8c9bb5542d16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:16.158333 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c1535990-1f3a-4035-b96f-8c9bb5542d16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1246 microversion: 2.1 time: 0.412161 Jun 30 16:34:16.159033 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 27/54] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:15 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1246 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:16.197206 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4e9406cd-6e39-4f31-a009-b562bee489df tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:16.211288 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4e9406cd-6e39-4f31-a009-b562bee489df tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:16.237882 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4e9406cd-6e39-4f31-a009-b562bee489df tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:16.248671 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4e9406cd-6e39-4f31-a009-b562bee489df tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:16.260211 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4e9406cd-6e39-4f31-a009-b562bee489df tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:16.260211 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4e9406cd-6e39-4f31-a009-b562bee489df tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:16.444187 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9571321c-b958-4201-8bc9-c9bade4203e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:16.501769 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9571321c-b958-4201-8bc9-c9bade4203e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 1.381759 Jun 30 16:34:16.523525 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 28/55] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:15 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:17.177478 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b37961ec-57a6-4a19-9ecc-214e59c4b6aa tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:17.177856 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b37961ec-57a6-4a19-9ecc-214e59c4b6aa tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:17.192718 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b37961ec-57a6-4a19-9ecc-214e59c4b6aa tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:17.194279 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b37961ec-57a6-4a19-9ecc-214e59c4b6aa tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:17.195346 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b37961ec-57a6-4a19-9ecc-214e59c4b6aa tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:17.200284 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b37961ec-57a6-4a19-9ecc-214e59c4b6aa tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:17.789165 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b37961ec-57a6-4a19-9ecc-214e59c4b6aa tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:17.803347 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b37961ec-57a6-4a19-9ecc-214e59c4b6aa tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1294 microversion: 2.1 time: 0.630418 Jun 30 16:34:17.808019 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 29/56] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:17 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1294 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:17.811500 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-fe1d5ea8-8412-4f46-99c2-1a7e998561ea tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:17.812538 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-fe1d5ea8-8412-4f46-99c2-1a7e998561ea tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:17.822499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe1d5ea8-8412-4f46-99c2-1a7e998561ea tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:17.823616 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe1d5ea8-8412-4f46-99c2-1a7e998561ea tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:17.824667 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe1d5ea8-8412-4f46-99c2-1a7e998561ea tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:17.825405 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe1d5ea8-8412-4f46-99c2-1a7e998561ea tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:18.546034 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4e9406cd-6e39-4f31-a009-b562bee489df tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:18.564166 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-4e9406cd-6e39-4f31-a009-b562bee489df tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 2.370787 Jun 30 16:34:18.579755 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 28/57] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:16 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 2420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:18.839242 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-b73cb9a5-fa63-41f7-aa79-8c427029b094 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:18.841406 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-b73cb9a5-fa63-41f7-aa79-8c427029b094 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:18.850728 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-fe1d5ea8-8412-4f46-99c2-1a7e998561ea tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:18.873323 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-fe1d5ea8-8412-4f46-99c2-1a7e998561ea tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 1.065883 Jun 30 16:34:18.876845 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 30/58] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:17 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:18.886501 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b73cb9a5-fa63-41f7-aa79-8c427029b094 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:18.889647 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b73cb9a5-fa63-41f7-aa79-8c427029b094 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:18.895350 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b73cb9a5-fa63-41f7-aa79-8c427029b094 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:18.899326 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b73cb9a5-fa63-41f7-aa79-8c427029b094 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:19.162613 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b73cb9a5-fa63-41f7-aa79-8c427029b094 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:19.208272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-b73cb9a5-fa63-41f7-aa79-8c427029b094 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1300 microversion: 2.1 time: 0.368337 Jun 30 16:34:19.212431 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 29/59] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:18 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1300 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:19.584376 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-13276226-3dd7-4527-aee7-3701449d5bb2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:19.591861 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-13276226-3dd7-4527-aee7-3701449d5bb2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:19.594528 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:19.644383 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-13276226-3dd7-4527-aee7-3701449d5bb2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:19.648343 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-13276226-3dd7-4527-aee7-3701449d5bb2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:19.655378 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-13276226-3dd7-4527-aee7-3701449d5bb2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:19.658647 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-13276226-3dd7-4527-aee7-3701449d5bb2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:19.721300 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1460009701", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8aed81da-8ea7-4176-b3f4-7d728693f230"}], "security_groups": [{"name": "tempest-securitygroup--110207310"}], "key_name": "tempest-keypair-2119489249", "user_data": "}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:20.030671 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.network.neutron [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] validate_networks() for [('8aed81da-8ea7-4176-b3f4-7d728693f230', None, None, None, None, None)] {{(pid=124814) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:34:20.098322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-13276226-3dd7-4527-aee7-3701449d5bb2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:20.110136 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=67 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:20.117346 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-13276226-3dd7-4527-aee7-3701449d5bb2 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 0.537449 Jun 30 16:34:20.118391 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 31/60] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:19 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:20.131811 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d0af0e59-1c1d-486f-85a1-e8e6e4b5df46 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:20.132790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d0af0e59-1c1d-486f-85a1-e8e6e4b5df46 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:20.140171 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d0af0e59-1c1d-486f-85a1-e8e6e4b5df46 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:20.140964 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d0af0e59-1c1d-486f-85a1-e8e6e4b5df46 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:20.142272 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d0af0e59-1c1d-486f-85a1-e8e6e4b5df46 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:20.142894 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d0af0e59-1c1d-486f-85a1-e8e6e4b5df46 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:20.384531 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d0af0e59-1c1d-486f-85a1-e8e6e4b5df46 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:20.390373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d0af0e59-1c1d-486f-85a1-e8e6e4b5df46 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 0.269399 Jun 30 16:34:20.396051 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 32/61] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:20 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:20.410805 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-86a93ba9-f0c2-47e4-9508-491702f76d7e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:20.411619 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-86a93ba9-f0c2-47e4-9508-491702f76d7e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:20.419672 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-86a93ba9-f0c2-47e4-9508-491702f76d7e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:20.423980 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-86a93ba9-f0c2-47e4-9508-491702f76d7e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:20.428546 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-86a93ba9-f0c2-47e4-9508-491702f76d7e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:20.428546 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-86a93ba9-f0c2-47e4-9508-491702f76d7e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:20.539039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-86a93ba9-f0c2-47e4-9508-491702f76d7e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:20.550077 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-86a93ba9-f0c2-47e4-9508-491702f76d7e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1300 microversion: 2.1 time: 0.151157 Jun 30 16:34:20.552495 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 33/62] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:20 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1300 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:20.567671 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-292944949", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93a4e560-3e75-48b5-b797-80cbf95a4a78"}], "security_groups": [{"name": "tempest-securitygroup--1803746741"}], "key_name": "tempest-keypair-2011843947", "user_data": "}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:20.832559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.network.neutron [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] validate_networks() for [('93a4e560-3e75-48b5-b797-80cbf95a4a78', None, None, None, None, None)] {{(pid=124815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:34:21.133243 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Flavor limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:34:21.134633 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Image limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:34:21.136481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Flavor pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:34:21.136970 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Image pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:34:21.137397 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:34:21.160277 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:21.160739 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:21.167192 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:21.168573 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:21.243172 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Getting quotas for project 80a9bf240ed0447faaf33bec8f19cb70. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:34:21.252091 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Getting quotas for user 18f2856b1d3742a1aca89b4aeec0a3bd and project 80a9bf240ed0447faaf33bec8f19cb70. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:34:21.278632 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Going to run 1 instances... {{(pid=124814) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:34:21.286310 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:34:21.490779 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-1229b555-3d02-41c2-a2f5-f0a3429028f0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.773610 Jun 30 16:34:21.497663 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 30/63] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:34:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 16:34:21.503899 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8d26bd18-0844-444c-a5ee-62391a1c6b30 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:21.504627 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8d26bd18-0844-444c-a5ee-62391a1c6b30 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:21.512279 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d26bd18-0844-444c-a5ee-62391a1c6b30 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:21.513027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d26bd18-0844-444c-a5ee-62391a1c6b30 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:21.513990 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d26bd18-0844-444c-a5ee-62391a1c6b30 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:21.514606 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d26bd18-0844-444c-a5ee-62391a1c6b30 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:21.829384 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8d26bd18-0844-444c-a5ee-62391a1c6b30 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:21.876569 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8d26bd18-0844-444c-a5ee-62391a1c6b30 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 0.377117 Jun 30 16:34:21.885309 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 31/64] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:21 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:21.901400 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d1d8dec9-d273-44ac-8bc4-2c8f2c2423a2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:21.904910 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d1d8dec9-d273-44ac-8bc4-2c8f2c2423a2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:21.914119 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Flavor limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:34:21.914613 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Image limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:34:21.915404 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Flavor pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:34:21.915848 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Image pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:34:21.916810 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:34:21.918901 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d1d8dec9-d273-44ac-8bc4-2c8f2c2423a2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:21.920496 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d1d8dec9-d273-44ac-8bc4-2c8f2c2423a2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:21.923123 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d1d8dec9-d273-44ac-8bc4-2c8f2c2423a2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:21.924203 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d1d8dec9-d273-44ac-8bc4-2c8f2c2423a2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:21.925371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=31 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:21.928191 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:21.928638 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:21.929440 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:21.929881 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:21.953749 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Getting quotas for project b66c389f8c5a47b2b97819e449c64ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:34:21.959339 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Getting quotas for user 7261ab46436e4546b8331aa8387cfa1c and project b66c389f8c5a47b2b97819e449c64ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:34:21.974337 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Going to run 1 instances... {{(pid=124815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:34:21.977337 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:34:22.152725 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2250fcd2-a743-4119-a993-2e87bc23e6b3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.598910 Jun 30 16:34:22.153311 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 34/65] 10.222.0.67 () {62 vars in 1187 bytes} [Thu Jun 30 16:34:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 1600 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 16:34:22.158519 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d91f6ca2-df3b-40fe-b178-f967723854a7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:22.159145 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d91f6ca2-df3b-40fe-b178-f967723854a7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:22.169751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d1d8dec9-d273-44ac-8bc4-2c8f2c2423a2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:22.183706 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d1d8dec9-d273-44ac-8bc4-2c8f2c2423a2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 0.291440 Jun 30 16:34:22.183706 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 32/66] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:21 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:22.186226 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f825448d-0592-4c2a-aa32-29359c4326b4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:22.186999 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f825448d-0592-4c2a-aa32-29359c4326b4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:22.193564 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f825448d-0592-4c2a-aa32-29359c4326b4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:22.194203 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f825448d-0592-4c2a-aa32-29359c4326b4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:22.195059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f825448d-0592-4c2a-aa32-29359c4326b4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:22.195610 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f825448d-0592-4c2a-aa32-29359c4326b4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:22.222560 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d91f6ca2-df3b-40fe-b178-f967723854a7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:22.248374 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d91f6ca2-df3b-40fe-b178-f967723854a7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1238 microversion: 2.1 time: 0.085001 Jun 30 16:34:22.248374 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 35/67] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:22 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:22.248374 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e7009a7c-746d-49ba-848d-1cc07033d460 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:22.248374 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e7009a7c-746d-49ba-848d-1cc07033d460 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:22.323719 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e7009a7c-746d-49ba-848d-1cc07033d460 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:22.329891 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e7009a7c-746d-49ba-848d-1cc07033d460 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:22.331644 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e7009a7c-746d-49ba-848d-1cc07033d460 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:22.333107 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e7009a7c-746d-49ba-848d-1cc07033d460 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1281 microversion: 2.20 time: 0.091753 Jun 30 16:34:22.333657 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 36/68] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:22 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:22.395789 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f825448d-0592-4c2a-aa32-29359c4326b4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:22.404278 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f825448d-0592-4c2a-aa32-29359c4326b4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1367 microversion: 2.1 time: 0.222936 Jun 30 16:34:22.404993 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 33/69] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:22 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:22.902563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a2f442af-76ef-4519-ad88-dc13f3dcca23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:22.903170 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a2f442af-76ef-4519-ad88-dc13f3dcca23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:22.909997 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a2f442af-76ef-4519-ad88-dc13f3dcca23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:22.910462 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a2f442af-76ef-4519-ad88-dc13f3dcca23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:22.911268 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a2f442af-76ef-4519-ad88-dc13f3dcca23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:22.911739 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a2f442af-76ef-4519-ad88-dc13f3dcca23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:23.065916 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a2f442af-76ef-4519-ad88-dc13f3dcca23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:23.074880 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a2f442af-76ef-4519-ad88-dc13f3dcca23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 0.177336 Jun 30 16:34:23.075495 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 37/70] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:22 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:23.202746 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7fdb7fc8-a9d6-4628-9433-71e0ba875091 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:23.204087 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7fdb7fc8-a9d6-4628-9433-71e0ba875091 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:23.211706 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7fdb7fc8-a9d6-4628-9433-71e0ba875091 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:23.212159 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7fdb7fc8-a9d6-4628-9433-71e0ba875091 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:23.214434 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7fdb7fc8-a9d6-4628-9433-71e0ba875091 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:23.214434 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7fdb7fc8-a9d6-4628-9433-71e0ba875091 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:23.263597 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-78ff2b63-2d48-44ae-b893-40f90a961d44 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:23.264872 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-78ff2b63-2d48-44ae-b893-40f90a961d44 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:23.273302 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78ff2b63-2d48-44ae-b893-40f90a961d44 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:23.273764 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78ff2b63-2d48-44ae-b893-40f90a961d44 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:23.275547 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78ff2b63-2d48-44ae-b893-40f90a961d44 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:23.277213 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78ff2b63-2d48-44ae-b893-40f90a961d44 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:23.375940 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-78ff2b63-2d48-44ae-b893-40f90a961d44 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:23.386246 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-78ff2b63-2d48-44ae-b893-40f90a961d44 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1242 microversion: 2.1 time: 0.130471 Jun 30 16:34:23.386842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 38/71] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:23 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1242 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:23.392020 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8c62f92c-5ffc-4697-82e8-97ec0b2fbbaa tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:23.393093 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8c62f92c-5ffc-4697-82e8-97ec0b2fbbaa tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:23.415758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7fdb7fc8-a9d6-4628-9433-71e0ba875091 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:23.424404 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7fdb7fc8-a9d6-4628-9433-71e0ba875091 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 0.226721 Jun 30 16:34:23.426774 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 34/72] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:23 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:23.435377 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c191f3ab-4214-4fb8-827d-16496fec663d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:23.436399 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c191f3ab-4214-4fb8-827d-16496fec663d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:23.446297 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c191f3ab-4214-4fb8-827d-16496fec663d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:23.446826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c191f3ab-4214-4fb8-827d-16496fec663d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:23.448267 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c191f3ab-4214-4fb8-827d-16496fec663d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:23.448913 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c191f3ab-4214-4fb8-827d-16496fec663d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:23.457719 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8c62f92c-5ffc-4697-82e8-97ec0b2fbbaa tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:23.465953 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8c62f92c-5ffc-4697-82e8-97ec0b2fbbaa tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:23.467876 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8c62f92c-5ffc-4697-82e8-97ec0b2fbbaa tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:23.469008 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8c62f92c-5ffc-4697-82e8-97ec0b2fbbaa tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1281 microversion: 2.20 time: 0.081044 Jun 30 16:34:23.469569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 39/73] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:23 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:23.613371 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c191f3ab-4214-4fb8-827d-16496fec663d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:23.621614 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c191f3ab-4214-4fb8-827d-16496fec663d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1367 microversion: 2.1 time: 0.194494 Jun 30 16:34:23.622252 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 35/74] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:23 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:24.093215 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-3d66d7ae-7d99-44cc-9860-701cb93b06b7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:24.093980 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-3d66d7ae-7d99-44cc-9860-701cb93b06b7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:24.101210 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3d66d7ae-7d99-44cc-9860-701cb93b06b7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:24.101210 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3d66d7ae-7d99-44cc-9860-701cb93b06b7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:24.101913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3d66d7ae-7d99-44cc-9860-701cb93b06b7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:24.102354 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3d66d7ae-7d99-44cc-9860-701cb93b06b7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:24.276615 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-3d66d7ae-7d99-44cc-9860-701cb93b06b7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:24.285015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-3d66d7ae-7d99-44cc-9860-701cb93b06b7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 0.196327 Jun 30 16:34:24.285595 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 40/75] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:24 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:24.407652 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ad9fda46-0864-4c9a-bb59-641de108179f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:24.408586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ad9fda46-0864-4c9a-bb59-641de108179f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:24.418949 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad9fda46-0864-4c9a-bb59-641de108179f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:24.419605 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad9fda46-0864-4c9a-bb59-641de108179f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:24.420396 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad9fda46-0864-4c9a-bb59-641de108179f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:24.420829 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad9fda46-0864-4c9a-bb59-641de108179f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:24.448670 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-534b6635-e8f5-437b-bd2a-0e9a5edcfb37 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:24.449552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-534b6635-e8f5-437b-bd2a-0e9a5edcfb37 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:24.458070 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-534b6635-e8f5-437b-bd2a-0e9a5edcfb37 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:24.458692 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-534b6635-e8f5-437b-bd2a-0e9a5edcfb37 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:24.459955 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-534b6635-e8f5-437b-bd2a-0e9a5edcfb37 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:24.460716 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-534b6635-e8f5-437b-bd2a-0e9a5edcfb37 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:24.500812 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ad9fda46-0864-4c9a-bb59-641de108179f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:24.511702 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ad9fda46-0864-4c9a-bb59-641de108179f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1242 microversion: 2.1 time: 0.112307 Jun 30 16:34:24.512630 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 36/76] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:24 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1242 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:24.518105 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-00a9cff9-5515-46cb-b7f5-7a7013c52850 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:24.518725 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-00a9cff9-5515-46cb-b7f5-7a7013c52850 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:24.525159 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-00a9cff9-5515-46cb-b7f5-7a7013c52850 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:24.525696 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-00a9cff9-5515-46cb-b7f5-7a7013c52850 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:24.527345 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-00a9cff9-5515-46cb-b7f5-7a7013c52850 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:24.527965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-00a9cff9-5515-46cb-b7f5-7a7013c52850 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:24.649856 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-00a9cff9-5515-46cb-b7f5-7a7013c52850 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:24.669198 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-00a9cff9-5515-46cb-b7f5-7a7013c52850 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:24.670778 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-00a9cff9-5515-46cb-b7f5-7a7013c52850 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:24.671986 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-00a9cff9-5515-46cb-b7f5-7a7013c52850 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1285 microversion: 2.20 time: 0.158141 Jun 30 16:34:24.672681 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 37/77] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:24 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1285 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:24.678006 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6829217a-5bd7-4350-bd52-2f23c9538577 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:24.678638 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6829217a-5bd7-4350-bd52-2f23c9538577 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:24.685651 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6829217a-5bd7-4350-bd52-2f23c9538577 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:24.686176 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6829217a-5bd7-4350-bd52-2f23c9538577 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:24.686971 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6829217a-5bd7-4350-bd52-2f23c9538577 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:24.687413 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6829217a-5bd7-4350-bd52-2f23c9538577 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:24.723197 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-534b6635-e8f5-437b-bd2a-0e9a5edcfb37 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:24.732235 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-534b6635-e8f5-437b-bd2a-0e9a5edcfb37 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 0.287833 Jun 30 16:34:24.734783 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 41/78] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:24 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:24.844066 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6829217a-5bd7-4350-bd52-2f23c9538577 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:24.851931 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6829217a-5bd7-4350-bd52-2f23c9538577 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1367 microversion: 2.1 time: 0.177963 Jun 30 16:34:24.856117 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 38/79] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:24 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:25.303632 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-cde9b357-7249-493d-a00f-96b7f2234fd7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:25.304243 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-cde9b357-7249-493d-a00f-96b7f2234fd7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:25.311013 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cde9b357-7249-493d-a00f-96b7f2234fd7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:25.311461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cde9b357-7249-493d-a00f-96b7f2234fd7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:25.312245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cde9b357-7249-493d-a00f-96b7f2234fd7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:25.312680 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cde9b357-7249-493d-a00f-96b7f2234fd7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:25.462357 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-cde9b357-7249-493d-a00f-96b7f2234fd7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:25.471246 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-cde9b357-7249-493d-a00f-96b7f2234fd7 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 0.171400 Jun 30 16:34:25.471864 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 42/80] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:25 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:25.529988 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-86fc57ac-f83e-48be-a506-f170cc6343eb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:25.530627 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-86fc57ac-f83e-48be-a506-f170cc6343eb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:25.536804 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-86fc57ac-f83e-48be-a506-f170cc6343eb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:25.592764 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-86fc57ac-f83e-48be-a506-f170cc6343eb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:25.592764 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-86fc57ac-f83e-48be-a506-f170cc6343eb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:25.592764 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-86fc57ac-f83e-48be-a506-f170cc6343eb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:25.607293 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-86fc57ac-f83e-48be-a506-f170cc6343eb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:25.614749 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-86fc57ac-f83e-48be-a506-f170cc6343eb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1242 microversion: 2.1 time: 0.089382 Jun 30 16:34:25.615317 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 39/81] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:25 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:25.696057 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a5bf8b28-5d84-47fa-80dc-9726e4168cfb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:25.696665 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a5bf8b28-5d84-47fa-80dc-9726e4168cfb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:25.707019 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a5bf8b28-5d84-47fa-80dc-9726e4168cfb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:25.707917 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a5bf8b28-5d84-47fa-80dc-9726e4168cfb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:25.709395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a5bf8b28-5d84-47fa-80dc-9726e4168cfb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:25.710190 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a5bf8b28-5d84-47fa-80dc-9726e4168cfb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:25.752016 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5f7a9291-5811-4a64-8ff4-d41e69eb21cb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:25.752625 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5f7a9291-5811-4a64-8ff4-d41e69eb21cb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:25.759137 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5f7a9291-5811-4a64-8ff4-d41e69eb21cb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:25.759615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5f7a9291-5811-4a64-8ff4-d41e69eb21cb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:25.760389 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5f7a9291-5811-4a64-8ff4-d41e69eb21cb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:25.761783 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5f7a9291-5811-4a64-8ff4-d41e69eb21cb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:25.822616 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a5bf8b28-5d84-47fa-80dc-9726e4168cfb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:25.836691 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a5bf8b28-5d84-47fa-80dc-9726e4168cfb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:25.838775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a5bf8b28-5d84-47fa-80dc-9726e4168cfb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:25.840159 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a5bf8b28-5d84-47fa-80dc-9726e4168cfb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1285 microversion: 2.20 time: 0.149758 Jun 30 16:34:25.840832 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 43/82] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:25 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:25.869705 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-fe5555e7-e970-4154-8c97-cb66be2bc0bc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:25.871367 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-fe5555e7-e970-4154-8c97-cb66be2bc0bc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:25.877828 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe5555e7-e970-4154-8c97-cb66be2bc0bc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:25.878289 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe5555e7-e970-4154-8c97-cb66be2bc0bc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:25.879073 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe5555e7-e970-4154-8c97-cb66be2bc0bc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:25.879541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe5555e7-e970-4154-8c97-cb66be2bc0bc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:25.915956 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5f7a9291-5811-4a64-8ff4-d41e69eb21cb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:25.925480 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5f7a9291-5811-4a64-8ff4-d41e69eb21cb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 0.177151 Jun 30 16:34:25.926131 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 40/83] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:25 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:26.029884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-fe5555e7-e970-4154-8c97-cb66be2bc0bc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:26.037371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-fe5555e7-e970-4154-8c97-cb66be2bc0bc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1367 microversion: 2.1 time: 0.171633 Jun 30 16:34:26.037935 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 44/84] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:25 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:26.489185 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3189df1b-a50e-4b14-bd25-acf87ee4f959 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:26.494639 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3189df1b-a50e-4b14-bd25-acf87ee4f959 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:26.496433 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3189df1b-a50e-4b14-bd25-acf87ee4f959 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:26.496884 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3189df1b-a50e-4b14-bd25-acf87ee4f959 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:26.497666 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3189df1b-a50e-4b14-bd25-acf87ee4f959 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:26.498101 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3189df1b-a50e-4b14-bd25-acf87ee4f959 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:26.634521 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0fa5c554-898a-488e-b69f-4d29991364d2 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:26.636484 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-0fa5c554-898a-488e-b69f-4d29991364d2 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:26.644861 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0fa5c554-898a-488e-b69f-4d29991364d2 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:26.646053 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0fa5c554-898a-488e-b69f-4d29991364d2 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:26.647236 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0fa5c554-898a-488e-b69f-4d29991364d2 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:26.647962 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0fa5c554-898a-488e-b69f-4d29991364d2 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:26.652089 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3189df1b-a50e-4b14-bd25-acf87ee4f959 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:26.659963 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3189df1b-a50e-4b14-bd25-acf87ee4f959 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 0.174618 Jun 30 16:34:26.660547 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 41/85] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:26 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:26.720351 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-0fa5c554-898a-488e-b69f-4d29991364d2 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:26.728696 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-0fa5c554-898a-488e-b69f-4d29991364d2 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1242 microversion: 2.1 time: 0.099913 Jun 30 16:34:26.732309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 45/86] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:26 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1242 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:26.858970 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f0836e07-ae4c-4500-b8ab-1a500a0beac2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:26.860085 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f0836e07-ae4c-4500-b8ab-1a500a0beac2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:26.866865 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f0836e07-ae4c-4500-b8ab-1a500a0beac2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:26.873929 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f0836e07-ae4c-4500-b8ab-1a500a0beac2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:26.873929 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f0836e07-ae4c-4500-b8ab-1a500a0beac2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:26.873929 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f0836e07-ae4c-4500-b8ab-1a500a0beac2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:26.944463 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-455d5dac-9f86-4692-9e05-62438120189f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:26.945381 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-455d5dac-9f86-4692-9e05-62438120189f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:26.953326 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-455d5dac-9f86-4692-9e05-62438120189f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:26.954116 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-455d5dac-9f86-4692-9e05-62438120189f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:26.955119 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-455d5dac-9f86-4692-9e05-62438120189f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:26.955767 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-455d5dac-9f86-4692-9e05-62438120189f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:26.989177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f0836e07-ae4c-4500-b8ab-1a500a0beac2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:26.998629 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f0836e07-ae4c-4500-b8ab-1a500a0beac2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:27.000476 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f0836e07-ae4c-4500-b8ab-1a500a0beac2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:27.001702 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f0836e07-ae4c-4500-b8ab-1a500a0beac2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1285 microversion: 2.20 time: 0.147133 Jun 30 16:34:27.003027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 42/87] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:26 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1285 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:27.054387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3de0a0cf-40bf-4bd6-a221-c5b9c0249117 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:27.055295 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3de0a0cf-40bf-4bd6-a221-c5b9c0249117 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:27.065447 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3de0a0cf-40bf-4bd6-a221-c5b9c0249117 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:27.065911 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3de0a0cf-40bf-4bd6-a221-c5b9c0249117 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:27.066699 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3de0a0cf-40bf-4bd6-a221-c5b9c0249117 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:27.067297 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3de0a0cf-40bf-4bd6-a221-c5b9c0249117 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:27.161250 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-455d5dac-9f86-4692-9e05-62438120189f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:27.171431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-455d5dac-9f86-4692-9e05-62438120189f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 0.230842 Jun 30 16:34:27.172748 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 46/88] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:26 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:27.282586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3de0a0cf-40bf-4bd6-a221-c5b9c0249117 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:27.291558 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3de0a0cf-40bf-4bd6-a221-c5b9c0249117 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1367 microversion: 2.1 time: 0.241027 Jun 30 16:34:27.303788 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 43/89] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:27 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:27.678129 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-74465703-e050-41c2-b577-12d93302eb9d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:27.679262 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-74465703-e050-41c2-b577-12d93302eb9d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:27.687037 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-74465703-e050-41c2-b577-12d93302eb9d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:27.687997 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-74465703-e050-41c2-b577-12d93302eb9d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:27.689362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-74465703-e050-41c2-b577-12d93302eb9d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:27.690113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-74465703-e050-41c2-b577-12d93302eb9d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:27.755763 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-228e4f1b-0d69-4f0b-90fa-88329051fcf6 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:27.761979 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-228e4f1b-0d69-4f0b-90fa-88329051fcf6 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:27.780675 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-228e4f1b-0d69-4f0b-90fa-88329051fcf6 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:27.784178 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-228e4f1b-0d69-4f0b-90fa-88329051fcf6 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:27.785290 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-228e4f1b-0d69-4f0b-90fa-88329051fcf6 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:27.788271 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-228e4f1b-0d69-4f0b-90fa-88329051fcf6 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:27.798255 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=100 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:27.921179 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-228e4f1b-0d69-4f0b-90fa-88329051fcf6 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:27.938247 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-228e4f1b-0d69-4f0b-90fa-88329051fcf6 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1242 microversion: 2.1 time: 0.191702 Jun 30 16:34:27.938852 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 44/90] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:27 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1242 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:27.992040 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-74465703-e050-41c2-b577-12d93302eb9d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:28.020146 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-74465703-e050-41c2-b577-12d93302eb9d tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 0.345755 Jun 30 16:34:28.023331 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 47/91] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:27 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:28.037519 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a39489fe-3731-4b22-86c8-aa912351630c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:28.039141 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a39489fe-3731-4b22-86c8-aa912351630c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:28.049968 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a39489fe-3731-4b22-86c8-aa912351630c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:28.051247 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a39489fe-3731-4b22-86c8-aa912351630c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:28.052738 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a39489fe-3731-4b22-86c8-aa912351630c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:28.054032 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a39489fe-3731-4b22-86c8-aa912351630c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:28.192426 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-5ebe759b-cdf4-48c3-8e90-0e6c0ccc96e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:28.193346 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-5ebe759b-cdf4-48c3-8e90-0e6c0ccc96e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:28.218385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5ebe759b-cdf4-48c3-8e90-0e6c0ccc96e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:28.219137 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5ebe759b-cdf4-48c3-8e90-0e6c0ccc96e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:28.220485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5ebe759b-cdf4-48c3-8e90-0e6c0ccc96e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:28.221253 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5ebe759b-cdf4-48c3-8e90-0e6c0ccc96e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:28.256962 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a39489fe-3731-4b22-86c8-aa912351630c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:28.268838 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a39489fe-3731-4b22-86c8-aa912351630c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:28.270751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a39489fe-3731-4b22-86c8-aa912351630c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:28.272013 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a39489fe-3731-4b22-86c8-aa912351630c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1285 microversion: 2.20 time: 0.252950 Jun 30 16:34:28.272588 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 45/92] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:28 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:34:28.311753 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-b112f744-22bb-45f7-8e2d-5c5ff268a992 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:28.312621 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-b112f744-22bb-45f7-8e2d-5c5ff268a992 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:28.342928 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b112f744-22bb-45f7-8e2d-5c5ff268a992 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:28.343879 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b112f744-22bb-45f7-8e2d-5c5ff268a992 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:28.345004 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b112f744-22bb-45f7-8e2d-5c5ff268a992 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:28.345955 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b112f744-22bb-45f7-8e2d-5c5ff268a992 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:28.576912 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5ebe759b-cdf4-48c3-8e90-0e6c0ccc96e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:28.592047 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-5ebe759b-cdf4-48c3-8e90-0e6c0ccc96e8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 0.405790 Jun 30 16:34:28.592709 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 48/93] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:28 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:28.606066 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b112f744-22bb-45f7-8e2d-5c5ff268a992 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:28.615806 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-b112f744-22bb-45f7-8e2d-5c5ff268a992 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1367 microversion: 2.1 time: 0.309573 Jun 30 16:34:28.616465 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 46/94] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:28 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:28.760680 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-05152360-bb26-4129-81e1-74811d1addf1 req-9236130a-123c-42bb-8f27-d7ce02a508d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285f3262-38a1-4c65-9680-18fa2ef40c32", "tag": "14804ed0-cd51-4355-ba1e-12c6728c4b2f"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:28.773536 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-05152360-bb26-4129-81e1-74811d1addf1 req-9236130a-123c-42bb-8f27-d7ce02a508d8 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:28.774371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-05152360-bb26-4129-81e1-74811d1addf1 req-9236130a-123c-42bb-8f27-d7ce02a508d8 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:28.788473 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-05152360-bb26-4129-81e1-74811d1addf1 req-9236130a-123c-42bb-8f27-d7ce02a508d8 service nova] Creating event network-changed:14804ed0-cd51-4355-ba1e-12c6728c4b2f for instance 285f3262-38a1-4c65-9680-18fa2ef40c32 on hv-cinder-83602 Jun 30 16:34:28.798637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-05152360-bb26-4129-81e1-74811d1addf1 req-9236130a-123c-42bb-8f27-d7ce02a508d8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042150 Jun 30 16:34:28.801551 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 49/95] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:34:28.969704 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5c4770b6-7707-46d8-b676-de534a6279bf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:28.971533 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5c4770b6-7707-46d8-b676-de534a6279bf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:29.002143 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5c4770b6-7707-46d8-b676-de534a6279bf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:29.008701 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5c4770b6-7707-46d8-b676-de534a6279bf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:29.022730 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5c4770b6-7707-46d8-b676-de534a6279bf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:29.022730 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5c4770b6-7707-46d8-b676-de534a6279bf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:29.051932 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-94ccb33f-403a-401c-b58d-0f52b810a6fc tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:29.053370 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-94ccb33f-403a-401c-b58d-0f52b810a6fc tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:29.096201 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94ccb33f-403a-401c-b58d-0f52b810a6fc tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:29.097361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94ccb33f-403a-401c-b58d-0f52b810a6fc tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:29.099158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94ccb33f-403a-401c-b58d-0f52b810a6fc tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:29.102041 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94ccb33f-403a-401c-b58d-0f52b810a6fc tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:29.290942 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5c4770b6-7707-46d8-b676-de534a6279bf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:29.301219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5c4770b6-7707-46d8-b676-de534a6279bf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1290 microversion: 2.1 time: 0.348757 Jun 30 16:34:29.302207 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 47/96] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:28 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1290 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:29.307402 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-46ab4a7b-217a-4cf8-9863-972ae1d1d485 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:29.308490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-46ab4a7b-217a-4cf8-9863-972ae1d1d485 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:29.323321 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-46ab4a7b-217a-4cf8-9863-972ae1d1d485 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:29.324427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-46ab4a7b-217a-4cf8-9863-972ae1d1d485 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:29.325140 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-46ab4a7b-217a-4cf8-9863-972ae1d1d485 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:29.332766 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-46ab4a7b-217a-4cf8-9863-972ae1d1d485 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:29.457521 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-46ab4a7b-217a-4cf8-9863-972ae1d1d485 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:29.484359 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-46ab4a7b-217a-4cf8-9863-972ae1d1d485 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:29.486105 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-46ab4a7b-217a-4cf8-9863-972ae1d1d485 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:29.487354 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-46ab4a7b-217a-4cf8-9863-972ae1d1d485 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1333 microversion: 2.20 time: 0.184030 Jun 30 16:34:29.488472 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 48/97] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:29 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1333 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:29.524506 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-94ccb33f-403a-401c-b58d-0f52b810a6fc tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:29.535110 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-94ccb33f-403a-401c-b58d-0f52b810a6fc tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 0.495686 Jun 30 16:34:29.537589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 50/98] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:29 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:29.610199 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-268cec1c-f337-4c31-a448-f19f9dce1446 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:29.611056 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-268cec1c-f337-4c31-a448-f19f9dce1446 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:29.619187 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-268cec1c-f337-4c31-a448-f19f9dce1446 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:29.619872 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-268cec1c-f337-4c31-a448-f19f9dce1446 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:29.621543 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-268cec1c-f337-4c31-a448-f19f9dce1446 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:29.622411 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-268cec1c-f337-4c31-a448-f19f9dce1446 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:29.654224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4008aeca-6aec-4c70-8656-6483ab356a0e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:29.661799 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4008aeca-6aec-4c70-8656-6483ab356a0e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:29.708322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4008aeca-6aec-4c70-8656-6483ab356a0e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:29.708322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4008aeca-6aec-4c70-8656-6483ab356a0e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:29.708322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4008aeca-6aec-4c70-8656-6483ab356a0e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:29.708322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4008aeca-6aec-4c70-8656-6483ab356a0e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:30.126089 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-268cec1c-f337-4c31-a448-f19f9dce1446 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:30.144513 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-268cec1c-f337-4c31-a448-f19f9dce1446 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 0.539079 Jun 30 16:34:30.145460 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 49/99] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:29 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:30.334200 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-bf1c2a9c-89d0-45ac-b409-6b1a27a6c3bc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:30.337719 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-bf1c2a9c-89d0-45ac-b409-6b1a27a6c3bc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:30.352158 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bf1c2a9c-89d0-45ac-b409-6b1a27a6c3bc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:30.353507 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bf1c2a9c-89d0-45ac-b409-6b1a27a6c3bc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:30.359641 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bf1c2a9c-89d0-45ac-b409-6b1a27a6c3bc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:30.361166 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bf1c2a9c-89d0-45ac-b409-6b1a27a6c3bc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:30.445001 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-4008aeca-6aec-4c70-8656-6483ab356a0e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:30.466291 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-4008aeca-6aec-4c70-8656-6483ab356a0e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1367 microversion: 2.1 time: 0.821033 Jun 30 16:34:30.476238 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 51/100] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:29 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1367 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:30.518047 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a13445de-44a7-4539-bfaa-1d10facd4273 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:30.521608 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a13445de-44a7-4539-bfaa-1d10facd4273 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:30.578529 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a13445de-44a7-4539-bfaa-1d10facd4273 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:30.579415 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a13445de-44a7-4539-bfaa-1d10facd4273 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:30.583063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a13445de-44a7-4539-bfaa-1d10facd4273 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:30.583063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a13445de-44a7-4539-bfaa-1d10facd4273 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:30.649616 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-bf1c2a9c-89d0-45ac-b409-6b1a27a6c3bc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:30.676722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-bf1c2a9c-89d0-45ac-b409-6b1a27a6c3bc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1298 microversion: 2.1 time: 0.353835 Jun 30 16:34:30.682784 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 50/101] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:30 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1298 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:30.718684 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-63857e95-d304-4f7b-bca8-570dd17472d9 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:30.721599 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-63857e95-d304-4f7b-bca8-570dd17472d9 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:30.734480 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-63857e95-d304-4f7b-bca8-570dd17472d9 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:30.734480 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-63857e95-d304-4f7b-bca8-570dd17472d9 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:30.734480 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-63857e95-d304-4f7b-bca8-570dd17472d9 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:30.754073 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-63857e95-d304-4f7b-bca8-570dd17472d9 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:30.845281 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a13445de-44a7-4539-bfaa-1d10facd4273 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:30.849890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=100 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:30.875566 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a13445de-44a7-4539-bfaa-1d10facd4273 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:30.878941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a13445de-44a7-4539-bfaa-1d10facd4273 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:30.881236 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a13445de-44a7-4539-bfaa-1d10facd4273 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1351 microversion: 2.20 time: 0.370376 Jun 30 16:34:30.882310 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 52/102] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:30 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1351 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:34:31.167848 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-30295043-d7cb-4bdf-a419-619a03584538 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:31.169870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-30295043-d7cb-4bdf-a419-619a03584538 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:31.187615 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-30295043-d7cb-4bdf-a419-619a03584538 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:31.197668 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-30295043-d7cb-4bdf-a419-619a03584538 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:31.200089 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-30295043-d7cb-4bdf-a419-619a03584538 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:31.200914 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-30295043-d7cb-4bdf-a419-619a03584538 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:31.202604 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=4 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:31.266075 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=8 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:31.404389 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-63857e95-d304-4f7b-bca8-570dd17472d9 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:31.438603 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-63857e95-d304-4f7b-bca8-570dd17472d9 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 0.752707 Jun 30 16:34:31.439856 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 51/103] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:30 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:31.613827 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-d217b7e2-6293-42b4-8212-f24226493329 req-e1beb2fd-41f4-4d68-8f66-a92ec3abb2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37aac043-7017-417e-a8dd-0a2619c5f38b", "name": "network-vif-plugged", "status": "completed", "tag": "c270e4fc-eb23-4881-be9d-da7f4f37912e"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:31.628239 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-d217b7e2-6293-42b4-8212-f24226493329 req-e1beb2fd-41f4-4d68-8f66-a92ec3abb2a6 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:31.629980 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-d217b7e2-6293-42b4-8212-f24226493329 req-e1beb2fd-41f4-4d68-8f66-a92ec3abb2a6 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:31.650517 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-30295043-d7cb-4bdf-a419-619a03584538 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:31.660480 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-30295043-d7cb-4bdf-a419-619a03584538 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 0.500838 Jun 30 16:34:31.660907 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 53/104] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:31 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:31.667291 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-12122cd2-fdea-4d86-bb83-1020eeef9171 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:31.668932 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-12122cd2-fdea-4d86-bb83-1020eeef9171 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:31.676741 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-12122cd2-fdea-4d86-bb83-1020eeef9171 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:31.677481 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-12122cd2-fdea-4d86-bb83-1020eeef9171 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:31.678737 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-12122cd2-fdea-4d86-bb83-1020eeef9171 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:31.679628 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-12122cd2-fdea-4d86-bb83-1020eeef9171 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:31.703351 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-d217b7e2-6293-42b4-8212-f24226493329 req-e1beb2fd-41f4-4d68-8f66-a92ec3abb2a6 service nova] Creating event network-vif-plugged:c270e4fc-eb23-4881-be9d-da7f4f37912e for instance 37aac043-7017-417e-a8dd-0a2619c5f38b on hv-cinder-83602 Jun 30 16:34:31.733459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-d217b7e2-6293-42b4-8212-f24226493329 req-e1beb2fd-41f4-4d68-8f66-a92ec3abb2a6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279604 Jun 30 16:34:31.743951 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 52/105] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:34:31.754791 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-68af2d03-f67b-4c54-ac49-0ef364d9a2d7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:31.781426 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-68af2d03-f67b-4c54-ac49-0ef364d9a2d7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:31.797875 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-68af2d03-f67b-4c54-ac49-0ef364d9a2d7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:31.798723 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-68af2d03-f67b-4c54-ac49-0ef364d9a2d7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:31.800323 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-68af2d03-f67b-4c54-ac49-0ef364d9a2d7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:31.801048 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-68af2d03-f67b-4c54-ac49-0ef364d9a2d7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:31.942903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=6 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:31.954578 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-68af2d03-f67b-4c54-ac49-0ef364d9a2d7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:31.979136 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-68af2d03-f67b-4c54-ac49-0ef364d9a2d7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1296 microversion: 2.1 time: 0.232577 Jun 30 16:34:31.985700 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 53/106] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:31 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1296 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:32.000396 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-46531810-0e3e-4a65-9415-de99b342716e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:32.002629 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-46531810-0e3e-4a65-9415-de99b342716e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:32.020537 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-46531810-0e3e-4a65-9415-de99b342716e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:32.025031 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-46531810-0e3e-4a65-9415-de99b342716e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:32.028448 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-46531810-0e3e-4a65-9415-de99b342716e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:32.032795 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-46531810-0e3e-4a65-9415-de99b342716e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:32.184477 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-46531810-0e3e-4a65-9415-de99b342716e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:32.194774 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-46531810-0e3e-4a65-9415-de99b342716e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:32.196531 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-46531810-0e3e-4a65-9415-de99b342716e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:32.197735 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-46531810-0e3e-4a65-9415-de99b342716e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1339 microversion: 2.20 time: 0.210767 Jun 30 16:34:32.198298 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 54/107] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:31 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1339 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:32.249872 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-12122cd2-fdea-4d86-bb83-1020eeef9171 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:32.260150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-12122cd2-fdea-4d86-bb83-1020eeef9171 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1367 microversion: 2.1 time: 0.597752 Jun 30 16:34:32.261494 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 54/108] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:31 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1367 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:32.469679 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-85c1c462-fb17-443c-8e58-0bb5b651f0e8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:32.470925 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-85c1c462-fb17-443c-8e58-0bb5b651f0e8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:32.494593 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-85c1c462-fb17-443c-8e58-0bb5b651f0e8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:32.496052 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-85c1c462-fb17-443c-8e58-0bb5b651f0e8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:32.499465 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-85c1c462-fb17-443c-8e58-0bb5b651f0e8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:32.501194 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-85c1c462-fb17-443c-8e58-0bb5b651f0e8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:32.706509 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-34fb5d39-8fcc-4614-b79a-f5f47cc901e2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:32.709265 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-34fb5d39-8fcc-4614-b79a-f5f47cc901e2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:32.728160 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-34fb5d39-8fcc-4614-b79a-f5f47cc901e2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:32.751529 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-34fb5d39-8fcc-4614-b79a-f5f47cc901e2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:32.761789 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-34fb5d39-8fcc-4614-b79a-f5f47cc901e2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:32.766098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-34fb5d39-8fcc-4614-b79a-f5f47cc901e2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:33.462618 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=11 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:33.547106 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-85c1c462-fb17-443c-8e58-0bb5b651f0e8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:33.564685 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-85c1c462-fb17-443c-8e58-0bb5b651f0e8 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 1.100333 Jun 30 16:34:33.573006 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 55/109] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:32 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:33.583027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-91583214-4b42-496e-b85d-6edd4b90be63 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:33.590078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-91583214-4b42-496e-b85d-6edd4b90be63 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:33.615782 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-91583214-4b42-496e-b85d-6edd4b90be63 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:33.616805 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-91583214-4b42-496e-b85d-6edd4b90be63 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:33.625384 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-91583214-4b42-496e-b85d-6edd4b90be63 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:33.626570 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-91583214-4b42-496e-b85d-6edd4b90be63 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:33.699068 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-34fb5d39-8fcc-4614-b79a-f5f47cc901e2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:33.708234 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-34fb5d39-8fcc-4614-b79a-f5f47cc901e2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 1.032571 Jun 30 16:34:33.715964 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 55/110] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:32 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:33.732493 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-567fb296-b2ab-44d9-853b-d9f16b405067 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:33.733452 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-567fb296-b2ab-44d9-853b-d9f16b405067 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:33.745508 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-567fb296-b2ab-44d9-853b-d9f16b405067 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:33.746279 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-567fb296-b2ab-44d9-853b-d9f16b405067 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:33.748375 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-567fb296-b2ab-44d9-853b-d9f16b405067 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:33.754223 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-567fb296-b2ab-44d9-853b-d9f16b405067 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:34.250194 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-567fb296-b2ab-44d9-853b-d9f16b405067 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:34.263892 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-567fb296-b2ab-44d9-853b-d9f16b405067 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:34.265528 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-567fb296-b2ab-44d9-853b-d9f16b405067 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:34.266722 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-567fb296-b2ab-44d9-853b-d9f16b405067 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1407 microversion: 2.20 time: 0.549393 Jun 30 16:34:34.271264 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 56/111] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:33 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1407 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:34.284806 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-91583214-4b42-496e-b85d-6edd4b90be63 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:34.285040 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8a713037-3dd0-47f9-b5c8-421663f8a684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:34.285473 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8a713037-3dd0-47f9-b5c8-421663f8a684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:34.298043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-91583214-4b42-496e-b85d-6edd4b90be63 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1363 microversion: 2.1 time: 0.728415 Jun 30 16:34:34.298670 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8a713037-3dd0-47f9-b5c8-421663f8a684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:34.299189 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 56/112] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:33 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1363 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:34.299688 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8a713037-3dd0-47f9-b5c8-421663f8a684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:34.300570 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8a713037-3dd0-47f9-b5c8-421663f8a684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:34.301003 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8a713037-3dd0-47f9-b5c8-421663f8a684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:34.359809 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-f8a78504-2a5d-4cc8-9629-40e5668cff68 req-311db813-7186-49c3-b23a-78894e1de85a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc16fc2-454c-4941-8709-fc424d36d88c", "name": "network-vif-plugged", "status": "completed", "tag": "b34f2ec4-8c64-4f05-98bb-ea3f485cf825"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:34.380016 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-f8a78504-2a5d-4cc8-9629-40e5668cff68 req-311db813-7186-49c3-b23a-78894e1de85a service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:34.381422 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-f8a78504-2a5d-4cc8-9629-40e5668cff68 req-311db813-7186-49c3-b23a-78894e1de85a service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:34.410128 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-f8a78504-2a5d-4cc8-9629-40e5668cff68 req-311db813-7186-49c3-b23a-78894e1de85a service nova] Creating event network-vif-plugged:b34f2ec4-8c64-4f05-98bb-ea3f485cf825 for instance 1cc16fc2-454c-4941-8709-fc424d36d88c on hv-cinder-83602 Jun 30 16:34:34.428542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-f8a78504-2a5d-4cc8-9629-40e5668cff68 req-311db813-7186-49c3-b23a-78894e1de85a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075278 Jun 30 16:34:34.432680 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 57/113] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:34:34.588121 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-30860415-3073-4ef6-ac8d-804135676d23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:34.592449 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-30860415-3073-4ef6-ac8d-804135676d23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:34.618977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-30860415-3073-4ef6-ac8d-804135676d23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:34.619172 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-30860415-3073-4ef6-ac8d-804135676d23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:34.619969 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-30860415-3073-4ef6-ac8d-804135676d23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:34.620484 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-30860415-3073-4ef6-ac8d-804135676d23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:34.692868 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8a713037-3dd0-47f9-b5c8-421663f8a684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:34.705396 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8a713037-3dd0-47f9-b5c8-421663f8a684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1367 microversion: 2.1 time: 0.427961 Jun 30 16:34:34.706376 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 57/114] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:34 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1367 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:34.729481 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-3b0d7ece-a7cd-4ce5-a6c9-56a75666033f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:34.730143 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-3b0d7ece-a7cd-4ce5-a6c9-56a75666033f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:34.744592 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3b0d7ece-a7cd-4ce5-a6c9-56a75666033f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:34.745007 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3b0d7ece-a7cd-4ce5-a6c9-56a75666033f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:34.745824 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3b0d7ece-a7cd-4ce5-a6c9-56a75666033f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:34.746273 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3b0d7ece-a7cd-4ce5-a6c9-56a75666033f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:35.357239 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-30860415-3073-4ef6-ac8d-804135676d23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:35.385963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-3b0d7ece-a7cd-4ce5-a6c9-56a75666033f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:35.407970 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-3b0d7ece-a7cd-4ce5-a6c9-56a75666033f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 0.685242 Jun 30 16:34:35.409795 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-30860415-3073-4ef6-ac8d-804135676d23 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1313 microversion: 2.1 time: 0.811318 Jun 30 16:34:35.411446 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 58/115] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:34 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1313 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:35.425012 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 58/116] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:34 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:35.436397 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-3bc4dc9e-5769-4cad-9b0b-b48c807dc243 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:35.440469 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-3bc4dc9e-5769-4cad-9b0b-b48c807dc243 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:35.440624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-92bb2f1d-f03d-4071-bbed-f2c9c4793727 req-3db8599d-be59-4227-936a-7de6db62cdfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f21182-53c1-471e-b55f-3f5654e72daf", "tag": "159acf30-2cf3-40f6-aa1f-50b4d29f5f28"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:35.447516 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3bc4dc9e-5769-4cad-9b0b-b48c807dc243 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:35.448632 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3bc4dc9e-5769-4cad-9b0b-b48c807dc243 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:35.449781 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3bc4dc9e-5769-4cad-9b0b-b48c807dc243 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:35.451434 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3bc4dc9e-5769-4cad-9b0b-b48c807dc243 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:35.483226 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-92bb2f1d-f03d-4071-bbed-f2c9c4793727 req-3db8599d-be59-4227-936a-7de6db62cdfd service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:35.483226 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-92bb2f1d-f03d-4071-bbed-f2c9c4793727 req-3db8599d-be59-4227-936a-7de6db62cdfd service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:35.519080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-92bb2f1d-f03d-4071-bbed-f2c9c4793727 req-3db8599d-be59-4227-936a-7de6db62cdfd service nova] Creating event network-changed:159acf30-2cf3-40f6-aa1f-50b4d29f5f28 for instance 32f21182-53c1-471e-b55f-3f5654e72daf on hv-cinder-83602 Jun 30 16:34:35.534655 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-92bb2f1d-f03d-4071-bbed-f2c9c4793727 req-3db8599d-be59-4227-936a-7de6db62cdfd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117592 Jun 30 16:34:35.536603 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 59/117] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:34:35.554412 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4114a422-9645-4d6b-b7c6-c3c22f3406d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:35.558324 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4114a422-9645-4d6b-b7c6-c3c22f3406d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:35.575353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4114a422-9645-4d6b-b7c6-c3c22f3406d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:35.575882 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4114a422-9645-4d6b-b7c6-c3c22f3406d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:35.576744 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4114a422-9645-4d6b-b7c6-c3c22f3406d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:35.577193 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4114a422-9645-4d6b-b7c6-c3c22f3406d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:35.822200 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-3bc4dc9e-5769-4cad-9b0b-b48c807dc243 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:35.834828 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-3bc4dc9e-5769-4cad-9b0b-b48c807dc243 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:35.836919 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-3bc4dc9e-5769-4cad-9b0b-b48c807dc243 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:35.838294 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-3bc4dc9e-5769-4cad-9b0b-b48c807dc243 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1407 microversion: 2.20 time: 0.412083 Jun 30 16:34:35.839337 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 59/118] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:35 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:35.845602 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-63efd64a-0727-41af-b04b-f45cc1eb17b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:35.846504 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-63efd64a-0727-41af-b04b-f45cc1eb17b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:35.880256 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-63efd64a-0727-41af-b04b-f45cc1eb17b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:35.880733 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-63efd64a-0727-41af-b04b-f45cc1eb17b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:35.887273 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-63efd64a-0727-41af-b04b-f45cc1eb17b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:35.888366 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4114a422-9645-4d6b-b7c6-c3c22f3406d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:35.888937 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-63efd64a-0727-41af-b04b-f45cc1eb17b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:35.931540 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-4114a422-9645-4d6b-b7c6-c3c22f3406d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1363 microversion: 2.1 time: 0.386971 Jun 30 16:34:35.935945 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 60/119] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:35 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1363 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:36.006689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-295e0362-6528-47e3-b0fd-711c8d92e575 req-acf81192-9ebc-45fe-aab6-8fb5a90504ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1f1412-017f-448b-a6bb-21d09d668a46", "tag": "feb9d98a-c1aa-45cf-b1e3-06597d656e69"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:36.048727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-295e0362-6528-47e3-b0fd-711c8d92e575 req-acf81192-9ebc-45fe-aab6-8fb5a90504ef service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:36.049436 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-295e0362-6528-47e3-b0fd-711c8d92e575 req-acf81192-9ebc-45fe-aab6-8fb5a90504ef service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:36.078838 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-295e0362-6528-47e3-b0fd-711c8d92e575 req-acf81192-9ebc-45fe-aab6-8fb5a90504ef service nova] Creating event network-changed:feb9d98a-c1aa-45cf-b1e3-06597d656e69 for instance ab1f1412-017f-448b-a6bb-21d09d668a46 on hv-cinder-83602 Jun 30 16:34:36.123750 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-295e0362-6528-47e3-b0fd-711c8d92e575 req-acf81192-9ebc-45fe-aab6-8fb5a90504ef service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120618 Jun 30 16:34:36.128626 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 61/120] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:34:36.198696 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-63efd64a-0727-41af-b04b-f45cc1eb17b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:36.207626 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-63efd64a-0727-41af-b04b-f45cc1eb17b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1367 microversion: 2.1 time: 0.366883 Jun 30 16:34:36.208673 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 60/121] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:35 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:36.448831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-bfa83abe-077a-4fe3-9fdb-0189d9d56015 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:36.449682 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f88d75aa-4e1e-4a82-b040-51fe194418bb tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:36.451081 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f88d75aa-4e1e-4a82-b040-51fe194418bb tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:36.452934 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-bfa83abe-077a-4fe3-9fdb-0189d9d56015 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:36.474626 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f88d75aa-4e1e-4a82-b040-51fe194418bb tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:36.474994 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bfa83abe-077a-4fe3-9fdb-0189d9d56015 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:36.475687 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bfa83abe-077a-4fe3-9fdb-0189d9d56015 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:36.476522 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bfa83abe-077a-4fe3-9fdb-0189d9d56015 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:36.476969 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bfa83abe-077a-4fe3-9fdb-0189d9d56015 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:36.477245 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f88d75aa-4e1e-4a82-b040-51fe194418bb tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:36.478241 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f88d75aa-4e1e-4a82-b040-51fe194418bb tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:36.482454 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f88d75aa-4e1e-4a82-b040-51fe194418bb tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:36.983936 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-bfa83abe-077a-4fe3-9fdb-0189d9d56015 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:36.993294 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-bfa83abe-077a-4fe3-9fdb-0189d9d56015 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1321 microversion: 2.1 time: 0.554885 Jun 30 16:34:36.994566 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f88d75aa-4e1e-4a82-b040-51fe194418bb tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:37.004509 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 61/122] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:36 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1321 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:37.010502 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-00effa28-2b20-4393-a7a2-9c86366c26b7 req-c84f5afc-98f9-4697-892b-1d83694b8dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ce60666-aa28-4c5d-b893-faa7f10a777b", "name": "network-vif-plugged", "status": "completed", "tag": "8d6b84f1-0b05-4d2b-8419-4c63e8ef22b1"}, {"server_uuid": "285f3262-38a1-4c65-9680-18fa2ef40c32", "name": "network-vif-plugged", "status": "completed", "tag": "14804ed0-cd51-4355-ba1e-12c6728c4b2f"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:37.022761 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f88d75aa-4e1e-4a82-b040-51fe194418bb tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1499 microversion: 2.1 time: 0.585313 Jun 30 16:34:37.023384 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-00effa28-2b20-4393-a7a2-9c86366c26b7 req-c84f5afc-98f9-4697-892b-1d83694b8dfd service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:37.024068 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-00effa28-2b20-4393-a7a2-9c86366c26b7 req-c84f5afc-98f9-4697-892b-1d83694b8dfd service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:37.032283 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 62/123] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:36 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1499 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:37.048858 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-00effa28-2b20-4393-a7a2-9c86366c26b7 req-c84f5afc-98f9-4697-892b-1d83694b8dfd service nova] Creating event network-vif-plugged:8d6b84f1-0b05-4d2b-8419-4c63e8ef22b1 for instance 6ce60666-aa28-4c5d-b893-faa7f10a777b on hv-cinder-83602 Jun 30 16:34:37.050340 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-00effa28-2b20-4393-a7a2-9c86366c26b7 req-c84f5afc-98f9-4697-892b-1d83694b8dfd service nova] Creating event network-vif-plugged:14804ed0-cd51-4355-ba1e-12c6728c4b2f for instance 285f3262-38a1-4c65-9680-18fa2ef40c32 on hv-cinder-83602 Jun 30 16:34:37.061845 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-00effa28-2b20-4393-a7a2-9c86366c26b7 req-c84f5afc-98f9-4697-892b-1d83694b8dfd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053696 Jun 30 16:34:37.062588 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 62/124] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:34:37.066543 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3662d7c6-5b06-4b4f-9e9b-f18dc89f9727 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:37.074339 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-be7777c2-c58f-4a54-956f-33ca3174262f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:37.075372 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-be7777c2-c58f-4a54-956f-33ca3174262f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:37.082720 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3662d7c6-5b06-4b4f-9e9b-f18dc89f9727 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:37.089563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-be7777c2-c58f-4a54-956f-33ca3174262f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:37.091343 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-be7777c2-c58f-4a54-956f-33ca3174262f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:37.094842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-be7777c2-c58f-4a54-956f-33ca3174262f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:37.096467 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-be7777c2-c58f-4a54-956f-33ca3174262f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:37.108074 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3662d7c6-5b06-4b4f-9e9b-f18dc89f9727 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:37.108866 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3662d7c6-5b06-4b4f-9e9b-f18dc89f9727 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:37.113884 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3662d7c6-5b06-4b4f-9e9b-f18dc89f9727 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:37.114626 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3662d7c6-5b06-4b4f-9e9b-f18dc89f9727 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:37.172039 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=100 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:37.373622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-be7777c2-c58f-4a54-956f-33ca3174262f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:37.381813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-be7777c2-c58f-4a54-956f-33ca3174262f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1363 microversion: 2.1 time: 0.313457 Jun 30 16:34:37.382429 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 63/125] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:37 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1363 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:37.387495 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1455a39f-21a4-4b9f-92b9-46804102afca tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:37.389038 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1455a39f-21a4-4b9f-92b9-46804102afca tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:37.396172 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1455a39f-21a4-4b9f-92b9-46804102afca tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:37.397018 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1455a39f-21a4-4b9f-92b9-46804102afca tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:37.398106 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1455a39f-21a4-4b9f-92b9-46804102afca tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:37.398706 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1455a39f-21a4-4b9f-92b9-46804102afca tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:37.430166 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3662d7c6-5b06-4b4f-9e9b-f18dc89f9727 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:37.447285 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3662d7c6-5b06-4b4f-9e9b-f18dc89f9727 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:37.453293 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3662d7c6-5b06-4b4f-9e9b-f18dc89f9727 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:37.455757 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3662d7c6-5b06-4b4f-9e9b-f18dc89f9727 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1407 microversion: 2.20 time: 0.418475 Jun 30 16:34:37.457489 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 63/126] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:37 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1407 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:37.633450 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1455a39f-21a4-4b9f-92b9-46804102afca tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:37.642443 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1455a39f-21a4-4b9f-92b9-46804102afca tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1367 microversion: 2.1 time: 0.258706 Jun 30 16:34:37.643382 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 64/127] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:37 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:38.024876 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e662eb35-5825-4f22-af9a-826def017755 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:38.024876 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e662eb35-5825-4f22-af9a-826def017755 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:38.043062 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e662eb35-5825-4f22-af9a-826def017755 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:38.043825 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e662eb35-5825-4f22-af9a-826def017755 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:38.045358 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e662eb35-5825-4f22-af9a-826def017755 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:38.046130 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e662eb35-5825-4f22-af9a-826def017755 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:38.303663 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-e662eb35-5825-4f22-af9a-826def017755 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:38.321650 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e662eb35-5825-4f22-af9a-826def017755 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1513 microversion: 2.1 time: 0.312296 Jun 30 16:34:38.339497 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 64/128] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:38 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1513 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:38.352871 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-beb0cd1d-d3ef-4507-b8a1-a69edd431ad3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:38.354613 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-beb0cd1d-d3ef-4507-b8a1-a69edd431ad3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:38.362676 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-beb0cd1d-d3ef-4507-b8a1-a69edd431ad3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:38.363420 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-beb0cd1d-d3ef-4507-b8a1-a69edd431ad3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:38.364272 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-beb0cd1d-d3ef-4507-b8a1-a69edd431ad3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:38.364717 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-beb0cd1d-d3ef-4507-b8a1-a69edd431ad3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:38.410709 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c250f732-6de7-4e38-bab4-02710a5be10f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:38.412198 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c250f732-6de7-4e38-bab4-02710a5be10f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:38.438954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-beb0cd1d-d3ef-4507-b8a1-a69edd431ad3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lazy-loading 'flavor' on Instance uuid 1cc16fc2-454c-4941-8709-fc424d36d88c {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:34:38.449110 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c250f732-6de7-4e38-bab4-02710a5be10f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:38.453996 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c250f732-6de7-4e38-bab4-02710a5be10f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:38.456947 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c250f732-6de7-4e38-bab4-02710a5be10f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:38.459124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c250f732-6de7-4e38-bab4-02710a5be10f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:39.066254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-beb0cd1d-d3ef-4507-b8a1-a69edd431ad3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "POST /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c/action" status: 200 len: 32 microversion: 2.1 time: 0.717263 Jun 30 16:34:39.067244 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 65/129] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 30 16:34:38 2022] POST /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c/action => generated 32 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 30 16:34:39.077209 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c250f732-6de7-4e38-bab4-02710a5be10f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:39.078252 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d73b12d9-4479-4362-857b-3313a4f7e7cf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:39.079319 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d73b12d9-4479-4362-857b-3313a4f7e7cf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:39.086245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d73b12d9-4479-4362-857b-3313a4f7e7cf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:39.086837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d73b12d9-4479-4362-857b-3313a4f7e7cf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:39.087577 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c250f732-6de7-4e38-bab4-02710a5be10f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1363 microversion: 2.1 time: 0.684724 Jun 30 16:34:39.087810 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d73b12d9-4479-4362-857b-3313a4f7e7cf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:39.088082 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d73b12d9-4479-4362-857b-3313a4f7e7cf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:39.088775 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 65/130] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:38 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1363 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:39.096379 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-dac21165-8c87-4d37-b41d-acfa7cf3f923 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:39.097264 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-dac21165-8c87-4d37-b41d-acfa7cf3f923 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:39.106067 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dac21165-8c87-4d37-b41d-acfa7cf3f923 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:39.106598 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dac21165-8c87-4d37-b41d-acfa7cf3f923 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:39.107927 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dac21165-8c87-4d37-b41d-acfa7cf3f923 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:39.108365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dac21165-8c87-4d37-b41d-acfa7cf3f923 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:39.406424 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d73b12d9-4479-4362-857b-3313a4f7e7cf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:39.406953 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-dac21165-8c87-4d37-b41d-acfa7cf3f923 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:39.412709 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-dac21165-8c87-4d37-b41d-acfa7cf3f923 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1367 microversion: 2.1 time: 0.322283 Jun 30 16:34:39.413719 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 66/131] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:39 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:39.414436 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d73b12d9-4479-4362-857b-3313a4f7e7cf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:39.416456 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d73b12d9-4479-4362-857b-3313a4f7e7cf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:39.417815 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d73b12d9-4479-4362-857b-3313a4f7e7cf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1407 microversion: 2.20 time: 0.348810 Jun 30 16:34:39.418375 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 66/132] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:39 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1407 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:39.419429 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d5c01c40-728a-47c8-98d2-cac2e05c7a0f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:39.420084 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d5c01c40-728a-47c8-98d2-cac2e05c7a0f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:39.432633 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d5c01c40-728a-47c8-98d2-cac2e05c7a0f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:39.433144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d5c01c40-728a-47c8-98d2-cac2e05c7a0f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:39.434060 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d5c01c40-728a-47c8-98d2-cac2e05c7a0f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:39.434615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d5c01c40-728a-47c8-98d2-cac2e05c7a0f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:39.676847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d5c01c40-728a-47c8-98d2-cac2e05c7a0f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:39.689163 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d5c01c40-728a-47c8-98d2-cac2e05c7a0f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.273534 Jun 30 16:34:39.689964 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 67/133] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:39 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:40.109539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c739e214-f9dd-4bd3-8e7d-99961bd8ad4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:40.110213 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c739e214-f9dd-4bd3-8e7d-99961bd8ad4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:40.116844 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c739e214-f9dd-4bd3-8e7d-99961bd8ad4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:40.117401 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c739e214-f9dd-4bd3-8e7d-99961bd8ad4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:40.129509 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c739e214-f9dd-4bd3-8e7d-99961bd8ad4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:40.129509 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c739e214-f9dd-4bd3-8e7d-99961bd8ad4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:40.277612 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c739e214-f9dd-4bd3-8e7d-99961bd8ad4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:40.286858 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c739e214-f9dd-4bd3-8e7d-99961bd8ad4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1363 microversion: 2.1 time: 0.182135 Jun 30 16:34:40.287442 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 67/134] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:40 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:40.449126 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-64b87db3-97eb-4d51-b137-2c7b974f9119 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:40.449800 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1cb9627e-b286-4ea4-86a0-ed39d0a163d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:40.450212 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-64b87db3-97eb-4d51-b137-2c7b974f9119 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:40.450579 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1cb9627e-b286-4ea4-86a0-ed39d0a163d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:40.458872 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:40.461930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1cb9627e-b286-4ea4-86a0-ed39d0a163d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:40.468896 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1cb9627e-b286-4ea4-86a0-ed39d0a163d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:40.468896 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1cb9627e-b286-4ea4-86a0-ed39d0a163d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:40.468896 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1cb9627e-b286-4ea4-86a0-ed39d0a163d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:40.471837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:40.477261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-64b87db3-97eb-4d51-b137-2c7b974f9119 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:40.477715 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-64b87db3-97eb-4d51-b137-2c7b974f9119 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:40.483517 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-64b87db3-97eb-4d51-b137-2c7b974f9119 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:40.484108 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-64b87db3-97eb-4d51-b137-2c7b974f9119 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:40.738897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1cb9627e-b286-4ea4-86a0-ed39d0a163d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:40.758085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1cb9627e-b286-4ea4-86a0-ed39d0a163d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:40.761700 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1cb9627e-b286-4ea4-86a0-ed39d0a163d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:40.765095 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1cb9627e-b286-4ea4-86a0-ed39d0a163d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1407 microversion: 2.20 time: 0.322825 Jun 30 16:34:40.766600 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 68/135] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:40 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:34:40.777030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-3a4e075a-2550-4190-ad9d-54a1391f5927 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:40.778622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-3a4e075a-2550-4190-ad9d-54a1391f5927 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:40.792146 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3a4e075a-2550-4190-ad9d-54a1391f5927 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:40.793397 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3a4e075a-2550-4190-ad9d-54a1391f5927 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:40.796787 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3a4e075a-2550-4190-ad9d-54a1391f5927 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:40.800683 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3a4e075a-2550-4190-ad9d-54a1391f5927 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:40.804977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-64b87db3-97eb-4d51-b137-2c7b974f9119 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:40.814217 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-64b87db3-97eb-4d51-b137-2c7b974f9119 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1367 microversion: 2.1 time: 0.379322 Jun 30 16:34:40.815134 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 68/136] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:40 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:40.975501 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-3a4e075a-2550-4190-ad9d-54a1391f5927 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:40.984803 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-3a4e075a-2550-4190-ad9d-54a1391f5927 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.216248 Jun 30 16:34:40.985505 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 69/137] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:40 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:41.304141 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-463c9243-d7d9-4423-b506-d805a3b674f7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:41.304891 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-463c9243-d7d9-4423-b506-d805a3b674f7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:41.311174 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-463c9243-d7d9-4423-b506-d805a3b674f7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:41.311754 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-463c9243-d7d9-4423-b506-d805a3b674f7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:41.312530 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-463c9243-d7d9-4423-b506-d805a3b674f7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:41.312972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-463c9243-d7d9-4423-b506-d805a3b674f7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:41.467662 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-463c9243-d7d9-4423-b506-d805a3b674f7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:41.475034 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-463c9243-d7d9-4423-b506-d805a3b674f7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1363 microversion: 2.1 time: 0.174619 Jun 30 16:34:41.475721 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 69/138] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:41 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:41.797378 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-cb2ea878-b93e-43cd-ae0e-0470368f9778 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:41.798137 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-cb2ea878-b93e-43cd-ae0e-0470368f9778 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:41.801632 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:41.828083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cb2ea878-b93e-43cd-ae0e-0470368f9778 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:41.828671 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cb2ea878-b93e-43cd-ae0e-0470368f9778 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:41.829959 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cb2ea878-b93e-43cd-ae0e-0470368f9778 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:41.830578 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cb2ea878-b93e-43cd-ae0e-0470368f9778 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:41.840758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f0ef866b-47de-4738-a152-5df24f0105d5 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:41.841488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f0ef866b-47de-4738-a152-5df24f0105d5 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:41.852839 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f0ef866b-47de-4738-a152-5df24f0105d5 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:41.853300 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f0ef866b-47de-4738-a152-5df24f0105d5 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:41.854095 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f0ef866b-47de-4738-a152-5df24f0105d5 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:41.854535 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f0ef866b-47de-4738-a152-5df24f0105d5 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:42.162996 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-cb2ea878-b93e-43cd-ae0e-0470368f9778 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:42.172317 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-cb2ea878-b93e-43cd-ae0e-0470368f9778 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:42.173806 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-cb2ea878-b93e-43cd-ae0e-0470368f9778 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:42.174910 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-cb2ea878-b93e-43cd-ae0e-0470368f9778 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1407 microversion: 2.20 time: 0.382222 Jun 30 16:34:42.175485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 70/139] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:41 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1407 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:42.184583 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d021370c-5122-411e-98f2-bef6de016644 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:42.185197 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d021370c-5122-411e-98f2-bef6de016644 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:42.195126 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d021370c-5122-411e-98f2-bef6de016644 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:42.195656 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d021370c-5122-411e-98f2-bef6de016644 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:42.196581 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d021370c-5122-411e-98f2-bef6de016644 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:42.197019 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d021370c-5122-411e-98f2-bef6de016644 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:42.215108 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f0ef866b-47de-4738-a152-5df24f0105d5 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:42.224505 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f0ef866b-47de-4738-a152-5df24f0105d5 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1367 microversion: 2.1 time: 0.387821 Jun 30 16:34:42.225091 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 70/140] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:41 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1367 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:42.351761 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d021370c-5122-411e-98f2-bef6de016644 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:42.359804 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d021370c-5122-411e-98f2-bef6de016644 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.183143 Jun 30 16:34:42.360701 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 71/141] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:42 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:42.493940 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-10d53a11-461a-4ef5-a0ac-5f95acf1b229 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:42.495884 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-10d53a11-461a-4ef5-a0ac-5f95acf1b229 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:42.505067 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10d53a11-461a-4ef5-a0ac-5f95acf1b229 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:42.506633 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10d53a11-461a-4ef5-a0ac-5f95acf1b229 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:42.507664 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10d53a11-461a-4ef5-a0ac-5f95acf1b229 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:42.508591 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10d53a11-461a-4ef5-a0ac-5f95acf1b229 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:42.778769 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f835eccf-410a-41da-9aae-31680ecc5513 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04b2fb5e-76d8-4724-8c53-8ff9064ab98c"}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:42.781315 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f835eccf-410a-41da-9aae-31680ecc5513 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:42.797746 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f835eccf-410a-41da-9aae-31680ecc5513 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:42.804290 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f835eccf-410a-41da-9aae-31680ecc5513 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:42.808935 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f835eccf-410a-41da-9aae-31680ecc5513 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:42.809756 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f835eccf-410a-41da-9aae-31680ecc5513 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:42.841791 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-10d53a11-461a-4ef5-a0ac-5f95acf1b229 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:42.854269 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-10d53a11-461a-4ef5-a0ac-5f95acf1b229 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1363 microversion: 2.1 time: 0.365471 Jun 30 16:34:42.857252 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 71/142] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:42 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:43.196461 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c52888de-bf15-4a42-ada3-15b2567c7541 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:43.197438 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c52888de-bf15-4a42-ada3-15b2567c7541 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:43.206030 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c52888de-bf15-4a42-ada3-15b2567c7541 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:43.206476 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c52888de-bf15-4a42-ada3-15b2567c7541 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:43.207456 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c52888de-bf15-4a42-ada3-15b2567c7541 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:43.207941 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c52888de-bf15-4a42-ada3-15b2567c7541 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:43.367962 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c52888de-bf15-4a42-ada3-15b2567c7541 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:43.380107 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c52888de-bf15-4a42-ada3-15b2567c7541 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:43.381673 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c52888de-bf15-4a42-ada3-15b2567c7541 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:43.384214 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c52888de-bf15-4a42-ada3-15b2567c7541 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1407 microversion: 2.20 time: 0.194192 Jun 30 16:34:43.394367 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 72/143] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:43 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:34:43.399612 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5bf7bc54-361e-4c4b-bc6a-bbb0b34dadf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:43.400577 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5bf7bc54-361e-4c4b-bc6a-bbb0b34dadf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:43.410586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5bf7bc54-361e-4c4b-bc6a-bbb0b34dadf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:43.411034 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5bf7bc54-361e-4c4b-bc6a-bbb0b34dadf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:43.411826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5bf7bc54-361e-4c4b-bc6a-bbb0b34dadf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:43.412433 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5bf7bc54-361e-4c4b-bc6a-bbb0b34dadf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:43.619322 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5bf7bc54-361e-4c4b-bc6a-bbb0b34dadf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:43.631050 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5bf7bc54-361e-4c4b-bc6a-bbb0b34dadf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1557 microversion: 2.1 time: 0.235525 Jun 30 16:34:43.632030 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 73/144] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:43 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1557 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:43.642398 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-590170cd-17ad-407f-93a9-044afb887b75 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:43.643270 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-590170cd-17ad-407f-93a9-044afb887b75 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:43.656158 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-590170cd-17ad-407f-93a9-044afb887b75 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:43.656833 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-590170cd-17ad-407f-93a9-044afb887b75 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:43.657850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-590170cd-17ad-407f-93a9-044afb887b75 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:43.658409 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-590170cd-17ad-407f-93a9-044afb887b75 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:43.819530 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-590170cd-17ad-407f-93a9-044afb887b75 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:43.828226 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-590170cd-17ad-407f-93a9-044afb887b75 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.194911 Jun 30 16:34:43.831770 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 74/145] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:43 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:43.840746 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-53d25a1f-b979-46c7-8692-e5c40988292e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:43.841566 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-53d25a1f-b979-46c7-8692-e5c40988292e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:43.854829 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-53d25a1f-b979-46c7-8692-e5c40988292e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:43.855229 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-53d25a1f-b979-46c7-8692-e5c40988292e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:43.856043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-53d25a1f-b979-46c7-8692-e5c40988292e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:43.856476 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-53d25a1f-b979-46c7-8692-e5c40988292e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:44.001664 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-53d25a1f-b979-46c7-8692-e5c40988292e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168523 Jun 30 16:34:44.004316 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 75/146] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 30 16:34:43 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:34:44.017005 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9cb5c35b-45a1-4ac1-9146-02efa385f1e7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:44.018216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9cb5c35b-45a1-4ac1-9146-02efa385f1e7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:44.025761 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9cb5c35b-45a1-4ac1-9146-02efa385f1e7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:44.030987 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9cb5c35b-45a1-4ac1-9146-02efa385f1e7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:44.030987 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9cb5c35b-45a1-4ac1-9146-02efa385f1e7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:44.030987 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9cb5c35b-45a1-4ac1-9146-02efa385f1e7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:44.210886 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9cb5c35b-45a1-4ac1-9146-02efa385f1e7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:44.220747 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9cb5c35b-45a1-4ac1-9146-02efa385f1e7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1363 microversion: 2.1 time: 0.215119 Jun 30 16:34:44.222691 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 76/147] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:44 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:44.232870 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-95d63738-3d84-4a8d-9f1e-06d69faeb2dc req-343f3733-04e7-4a46-a696-b5ae8dedcb94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f21182-53c1-471e-b55f-3f5654e72daf", "name": "network-vif-plugged", "status": "completed", "tag": "159acf30-2cf3-40f6-aa1f-50b4d29f5f28"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:44.255330 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-95d63738-3d84-4a8d-9f1e-06d69faeb2dc req-343f3733-04e7-4a46-a696-b5ae8dedcb94 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:44.256029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-95d63738-3d84-4a8d-9f1e-06d69faeb2dc req-343f3733-04e7-4a46-a696-b5ae8dedcb94 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:44.273506 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-95d63738-3d84-4a8d-9f1e-06d69faeb2dc req-343f3733-04e7-4a46-a696-b5ae8dedcb94 service nova] Creating event network-vif-plugged:159acf30-2cf3-40f6-aa1f-50b4d29f5f28 for instance 32f21182-53c1-471e-b55f-3f5654e72daf on hv-cinder-83602 Jun 30 16:34:44.283239 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-95d63738-3d84-4a8d-9f1e-06d69faeb2dc req-343f3733-04e7-4a46-a696-b5ae8dedcb94 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058233 Jun 30 16:34:44.284445 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 77/148] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:34:44.409228 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7df4ab08-072a-41ff-9bab-b772bb173f5d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:44.409949 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7df4ab08-072a-41ff-9bab-b772bb173f5d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:44.427906 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7df4ab08-072a-41ff-9bab-b772bb173f5d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:44.428367 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7df4ab08-072a-41ff-9bab-b772bb173f5d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:44.429432 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7df4ab08-072a-41ff-9bab-b772bb173f5d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:44.429895 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7df4ab08-072a-41ff-9bab-b772bb173f5d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:44.696958 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7df4ab08-072a-41ff-9bab-b772bb173f5d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:44.708917 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7df4ab08-072a-41ff-9bab-b772bb173f5d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:44.710719 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7df4ab08-072a-41ff-9bab-b772bb173f5d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:44.712049 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7df4ab08-072a-41ff-9bab-b772bb173f5d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1407 microversion: 2.20 time: 0.313417 Jun 30 16:34:44.732075 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 78/149] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:44 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:44.846600 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1dde49b9-9338-4761-a66d-aa7c5bc46e45 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:44.847190 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-1dde49b9-9338-4761-a66d-aa7c5bc46e45 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:44.853518 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1dde49b9-9338-4761-a66d-aa7c5bc46e45 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:44.854247 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1dde49b9-9338-4761-a66d-aa7c5bc46e45 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:44.855031 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1dde49b9-9338-4761-a66d-aa7c5bc46e45 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:44.855495 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1dde49b9-9338-4761-a66d-aa7c5bc46e45 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:45.192458 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-1dde49b9-9338-4761-a66d-aa7c5bc46e45 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:45.204440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-1dde49b9-9338-4761-a66d-aa7c5bc46e45 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.361220 Jun 30 16:34:45.205040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 79/150] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:44 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:45.241560 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-eff2ce33-e402-47ea-a30f-45e50b57eb28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:45.242053 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-eff2ce33-e402-47ea-a30f-45e50b57eb28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:45.249556 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eff2ce33-e402-47ea-a30f-45e50b57eb28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:45.249993 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eff2ce33-e402-47ea-a30f-45e50b57eb28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:45.250937 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eff2ce33-e402-47ea-a30f-45e50b57eb28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:45.251555 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eff2ce33-e402-47ea-a30f-45e50b57eb28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:45.458326 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-eff2ce33-e402-47ea-a30f-45e50b57eb28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:45.468346 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-eff2ce33-e402-47ea-a30f-45e50b57eb28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1363 microversion: 2.1 time: 0.231388 Jun 30 16:34:45.469612 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 80/151] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:45 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:45.750888 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-65605b22-e235-41e1-9f89-f62b76ccb9ba tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:45.751557 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-65605b22-e235-41e1-9f89-f62b76ccb9ba tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:45.757885 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-65605b22-e235-41e1-9f89-f62b76ccb9ba tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:45.762138 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-65605b22-e235-41e1-9f89-f62b76ccb9ba tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:45.769972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-65605b22-e235-41e1-9f89-f62b76ccb9ba tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:45.770452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-65605b22-e235-41e1-9f89-f62b76ccb9ba tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:45.787819 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=100 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:34:46.000224 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-65605b22-e235-41e1-9f89-f62b76ccb9ba tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:46.016180 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-65605b22-e235-41e1-9f89-f62b76ccb9ba tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:46.019039 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-65605b22-e235-41e1-9f89-f62b76ccb9ba tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:46.021036 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-65605b22-e235-41e1-9f89-f62b76ccb9ba tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1407 microversion: 2.20 time: 0.274526 Jun 30 16:34:46.021908 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 81/152] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:45 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:34:46.044597 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f835eccf-410a-41da-9aae-31680ecc5513 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "POST /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.247764 Jun 30 16:34:46.047563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 72/153] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 30 16:34:42 2022] POST /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b/os-volume_attachments => generated 194 bytes in 3274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:34:46.222857 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-b22708a6-e7c3-4ec8-8ece-8b0f3237982f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:46.223939 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-b22708a6-e7c3-4ec8-8ece-8b0f3237982f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:46.237878 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b22708a6-e7c3-4ec8-8ece-8b0f3237982f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:46.238579 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b22708a6-e7c3-4ec8-8ece-8b0f3237982f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:46.239621 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b22708a6-e7c3-4ec8-8ece-8b0f3237982f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:46.241459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b22708a6-e7c3-4ec8-8ece-8b0f3237982f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:46.434570 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-c2fbfb84-2d58-4774-aafc-f4dad891c391 req-0e450ad8-d7d9-4db0-959c-3c783404df1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "285f3262-38a1-4c65-9680-18fa2ef40c32", "tag": "14804ed0-cd51-4355-ba1e-12c6728c4b2f"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:46.446024 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-c2fbfb84-2d58-4774-aafc-f4dad891c391 req-0e450ad8-d7d9-4db0-959c-3c783404df1d service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:46.446705 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-c2fbfb84-2d58-4774-aafc-f4dad891c391 req-0e450ad8-d7d9-4db0-959c-3c783404df1d service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:46.449621 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b22708a6-e7c3-4ec8-8ece-8b0f3237982f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:46.460084 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-c2fbfb84-2d58-4774-aafc-f4dad891c391 req-0e450ad8-d7d9-4db0-959c-3c783404df1d service nova] Creating event network-changed:14804ed0-cd51-4355-ba1e-12c6728c4b2f for instance 285f3262-38a1-4c65-9680-18fa2ef40c32 on hv-cinder-83602 Jun 30 16:34:46.461688 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-b22708a6-e7c3-4ec8-8ece-8b0f3237982f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.244143 Jun 30 16:34:46.462964 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 82/154] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:46 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:46.466655 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-c2fbfb84-2d58-4774-aafc-f4dad891c391 req-0e450ad8-d7d9-4db0-959c-3c783404df1d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038181 Jun 30 16:34:46.471517 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 73/155] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:34:46.489240 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-bd7cf6f3-b35f-470a-a0af-236609059d05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:46.490084 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-bd7cf6f3-b35f-470a-a0af-236609059d05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:46.498491 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bd7cf6f3-b35f-470a-a0af-236609059d05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:46.499230 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bd7cf6f3-b35f-470a-a0af-236609059d05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:46.500681 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bd7cf6f3-b35f-470a-a0af-236609059d05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:46.501131 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bd7cf6f3-b35f-470a-a0af-236609059d05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:46.712962 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-bd7cf6f3-b35f-470a-a0af-236609059d05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:46.728216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-bd7cf6f3-b35f-470a-a0af-236609059d05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1363 microversion: 2.1 time: 0.246003 Jun 30 16:34:46.729672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 83/156] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:46 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:47.065069 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-29673053-53fc-4245-87e8-7bf47d4b07b8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:47.066410 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-29673053-53fc-4245-87e8-7bf47d4b07b8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:47.080702 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-29673053-53fc-4245-87e8-7bf47d4b07b8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:47.081839 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-29673053-53fc-4245-87e8-7bf47d4b07b8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:47.082916 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-29673053-53fc-4245-87e8-7bf47d4b07b8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:47.083437 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-29673053-53fc-4245-87e8-7bf47d4b07b8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:47.393938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-29673053-53fc-4245-87e8-7bf47d4b07b8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:47.404310 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-29673053-53fc-4245-87e8-7bf47d4b07b8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:47.406831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-29673053-53fc-4245-87e8-7bf47d4b07b8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:47.408167 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-29673053-53fc-4245-87e8-7bf47d4b07b8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1407 microversion: 2.20 time: 0.358382 Jun 30 16:34:47.408842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 74/157] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:47 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:47.484865 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a49d9186-1f07-4b15-851c-8ae56d61e39c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:47.491721 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a49d9186-1f07-4b15-851c-8ae56d61e39c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:47.495939 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a49d9186-1f07-4b15-851c-8ae56d61e39c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:47.503679 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a49d9186-1f07-4b15-851c-8ae56d61e39c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:47.504875 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a49d9186-1f07-4b15-851c-8ae56d61e39c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:47.505340 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a49d9186-1f07-4b15-851c-8ae56d61e39c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:47.720608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a49d9186-1f07-4b15-851c-8ae56d61e39c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:47.721626 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a49d9186-1f07-4b15-851c-8ae56d61e39c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.241798 Jun 30 16:34:47.722233 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 84/158] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:47 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:47.746839 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0199c48c-24de-49f1-bd3a-503ee6013afd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:47.747542 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-0199c48c-24de-49f1-bd3a-503ee6013afd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:47.755846 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0199c48c-24de-49f1-bd3a-503ee6013afd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:47.756307 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0199c48c-24de-49f1-bd3a-503ee6013afd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:47.757116 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0199c48c-24de-49f1-bd3a-503ee6013afd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:47.757605 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0199c48c-24de-49f1-bd3a-503ee6013afd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:48.113164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-0199c48c-24de-49f1-bd3a-503ee6013afd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:48.131757 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-0199c48c-24de-49f1-bd3a-503ee6013afd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1547 microversion: 2.1 time: 0.387988 Jun 30 16:34:48.166622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 75/159] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:47 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1547 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:48.181270 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1161aef8-c0c0-4d3c-956b-1af7f3bd9fe7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:48.182748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-1161aef8-c0c0-4d3c-956b-1af7f3bd9fe7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:48.204008 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1161aef8-c0c0-4d3c-956b-1af7f3bd9fe7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:48.204738 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1161aef8-c0c0-4d3c-956b-1af7f3bd9fe7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:48.205832 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1161aef8-c0c0-4d3c-956b-1af7f3bd9fe7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:48.206602 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1161aef8-c0c0-4d3c-956b-1af7f3bd9fe7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:48.392702 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-48327a97-49c9-4a9a-a3d5-2c9710012434 req-5b29a82c-12eb-426e-8e4e-5caa0c899782 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1f1412-017f-448b-a6bb-21d09d668a46", "name": "network-vif-plugged", "status": "completed", "tag": "feb9d98a-c1aa-45cf-b1e3-06597d656e69"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:48.414238 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-48327a97-49c9-4a9a-a3d5-2c9710012434 req-5b29a82c-12eb-426e-8e4e-5caa0c899782 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:48.414745 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-48327a97-49c9-4a9a-a3d5-2c9710012434 req-5b29a82c-12eb-426e-8e4e-5caa0c899782 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:48.431313 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-1161aef8-c0c0-4d3c-956b-1af7f3bd9fe7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.267374 Jun 30 16:34:48.431959 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-48327a97-49c9-4a9a-a3d5-2c9710012434 req-5b29a82c-12eb-426e-8e4e-5caa0c899782 service nova] Creating event network-vif-plugged:feb9d98a-c1aa-45cf-b1e3-06597d656e69 for instance ab1f1412-017f-448b-a6bb-21d09d668a46 on hv-cinder-83602 Jun 30 16:34:48.432611 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 85/160] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 30 16:34:48 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/os-interface => generated 284 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:34:48.445382 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-48327a97-49c9-4a9a-a3d5-2c9710012434 req-5b29a82c-12eb-426e-8e4e-5caa0c899782 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058482 Jun 30 16:34:48.447009 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 76/161] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:34:48.451837 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-aa52e8c2-547e-493b-8954-74820708ff0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:48.452811 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-aa52e8c2-547e-493b-8954-74820708ff0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:48.461509 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-aa52e8c2-547e-493b-8954-74820708ff0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:48.462347 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-aa52e8c2-547e-493b-8954-74820708ff0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:48.463553 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-aa52e8c2-547e-493b-8954-74820708ff0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:48.464028 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-aa52e8c2-547e-493b-8954-74820708ff0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:48.750774 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a00f1587-3f01-498d-b3eb-6cd17a16bc4d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:48.754711 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a00f1587-3f01-498d-b3eb-6cd17a16bc4d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:48.791856 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a00f1587-3f01-498d-b3eb-6cd17a16bc4d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:48.794746 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a00f1587-3f01-498d-b3eb-6cd17a16bc4d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:48.797653 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a00f1587-3f01-498d-b3eb-6cd17a16bc4d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:48.804087 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a00f1587-3f01-498d-b3eb-6cd17a16bc4d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:48.836295 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-aa52e8c2-547e-493b-8954-74820708ff0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:48.868175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-aa52e8c2-547e-493b-8954-74820708ff0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:48.872431 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-aa52e8c2-547e-493b-8954-74820708ff0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:48.875270 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-aa52e8c2-547e-493b-8954-74820708ff0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1407 microversion: 2.20 time: 0.431267 Jun 30 16:34:48.880747 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 86/162] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:48 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1407 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:34:49.160068 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a00f1587-3f01-498d-b3eb-6cd17a16bc4d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:49.170752 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a00f1587-3f01-498d-b3eb-6cd17a16bc4d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.434585 Jun 30 16:34:49.172029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 77/163] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:48 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:49.909964 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a9f6182f-4b01-45f2-8287-3eab755964cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:49.911219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a9f6182f-4b01-45f2-8287-3eab755964cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:49.920403 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a9f6182f-4b01-45f2-8287-3eab755964cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:49.921500 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a9f6182f-4b01-45f2-8287-3eab755964cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:49.928308 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a9f6182f-4b01-45f2-8287-3eab755964cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:49.929437 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a9f6182f-4b01-45f2-8287-3eab755964cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:50.192526 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-64b3f69d-c780-4ce1-b9ba-771277c5983a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:50.193725 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-64b3f69d-c780-4ce1-b9ba-771277c5983a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:50.204028 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-64b3f69d-c780-4ce1-b9ba-771277c5983a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:50.205002 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-64b3f69d-c780-4ce1-b9ba-771277c5983a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:50.206320 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-64b3f69d-c780-4ce1-b9ba-771277c5983a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:50.207028 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-64b3f69d-c780-4ce1-b9ba-771277c5983a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:50.214567 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a9f6182f-4b01-45f2-8287-3eab755964cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:50.230797 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a9f6182f-4b01-45f2-8287-3eab755964cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:50.234404 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a9f6182f-4b01-45f2-8287-3eab755964cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:50.236845 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a9f6182f-4b01-45f2-8287-3eab755964cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1407 microversion: 2.20 time: 0.331444 Jun 30 16:34:50.238598 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 87/164] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:49 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:50.430800 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-64b3f69d-c780-4ce1-b9ba-771277c5983a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:50.441993 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-64b3f69d-c780-4ce1-b9ba-771277c5983a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.256824 Jun 30 16:34:50.444804 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 78/165] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:50 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:50.535910 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-44b7eff3-5938-4407-9dbe-c7e30ba8736e req-84f55efe-9e3c-494e-8c56-bd6c8e886d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32f21182-53c1-471e-b55f-3f5654e72daf", "tag": "159acf30-2cf3-40f6-aa1f-50b4d29f5f28"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:50.556851 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-44b7eff3-5938-4407-9dbe-c7e30ba8736e req-84f55efe-9e3c-494e-8c56-bd6c8e886d16 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:50.558164 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-44b7eff3-5938-4407-9dbe-c7e30ba8736e req-84f55efe-9e3c-494e-8c56-bd6c8e886d16 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:50.594864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-44b7eff3-5938-4407-9dbe-c7e30ba8736e req-84f55efe-9e3c-494e-8c56-bd6c8e886d16 service nova] Creating event network-changed:159acf30-2cf3-40f6-aa1f-50b4d29f5f28 for instance 32f21182-53c1-471e-b55f-3f5654e72daf on hv-cinder-83602 Jun 30 16:34:50.606126 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-44b7eff3-5938-4407-9dbe-c7e30ba8736e req-84f55efe-9e3c-494e-8c56-bd6c8e886d16 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083283 Jun 30 16:34:50.608966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 88/166] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:34:51.268280 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-5869630b-9f86-4cc6-9451-f69cfcee0897 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:51.274485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-5869630b-9f86-4cc6-9451-f69cfcee0897 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:51.279686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5869630b-9f86-4cc6-9451-f69cfcee0897 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:51.280525 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5869630b-9f86-4cc6-9451-f69cfcee0897 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:51.281363 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5869630b-9f86-4cc6-9451-f69cfcee0897 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:51.282014 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5869630b-9f86-4cc6-9451-f69cfcee0897 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:51.618734 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-27cd21bb-984b-4110-877b-3dde425ef0c2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:51.618734 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-27cd21bb-984b-4110-877b-3dde425ef0c2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:51.618734 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-27cd21bb-984b-4110-877b-3dde425ef0c2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:51.618734 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-27cd21bb-984b-4110-877b-3dde425ef0c2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:51.620485 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-27cd21bb-984b-4110-877b-3dde425ef0c2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:51.620485 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-27cd21bb-984b-4110-877b-3dde425ef0c2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:51.621926 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5869630b-9f86-4cc6-9451-f69cfcee0897 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:51.621926 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5869630b-9f86-4cc6-9451-f69cfcee0897 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:51.623160 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5869630b-9f86-4cc6-9451-f69cfcee0897 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:51.623160 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-5869630b-9f86-4cc6-9451-f69cfcee0897 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1598 microversion: 2.20 time: 0.299998 Jun 30 16:34:51.623160 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 79/167] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:34:51 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1598 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:34:51.623160 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-37e63a4d-0338-40b9-ad15-b41d7b8f3c2c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:51.623759 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-37e63a4d-0338-40b9-ad15-b41d7b8f3c2c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:51.626082 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-37e63a4d-0338-40b9-ad15-b41d7b8f3c2c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:51.626533 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-37e63a4d-0338-40b9-ad15-b41d7b8f3c2c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:51.627319 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-37e63a4d-0338-40b9-ad15-b41d7b8f3c2c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:51.627792 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-37e63a4d-0338-40b9-ad15-b41d7b8f3c2c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:51.705970 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-27cd21bb-984b-4110-877b-3dde425ef0c2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:51.721194 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-27cd21bb-984b-4110-877b-3dde425ef0c2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.249770 Jun 30 16:34:51.729810 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 89/168] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:51 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:51.749405 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-37e63a4d-0338-40b9-ad15-b41d7b8f3c2c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.134611 Jun 30 16:34:51.750496 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 80/169] 10.222.0.67 () {60 vars in 1315 bytes} [Thu Jun 30 16:34:51 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 16:34:52.762035 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-234203a6-3f33-41d9-9be4-96bfdd9c0ac6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:52.768757 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-234203a6-3f33-41d9-9be4-96bfdd9c0ac6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:52.781242 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-234203a6-3f33-41d9-9be4-96bfdd9c0ac6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:52.785999 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-234203a6-3f33-41d9-9be4-96bfdd9c0ac6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:52.785999 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-234203a6-3f33-41d9-9be4-96bfdd9c0ac6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:52.785999 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-234203a6-3f33-41d9-9be4-96bfdd9c0ac6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:53.161203 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-234203a6-3f33-41d9-9be4-96bfdd9c0ac6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:53.171079 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-234203a6-3f33-41d9-9be4-96bfdd9c0ac6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.432554 Jun 30 16:34:53.172714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 90/170] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:52 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:53.773385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-4325302d-0160-4180-a005-e3412ba125ef req-b2c0ecbd-d7b8-472a-8f7d-ae9ef38b0c96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab1f1412-017f-448b-a6bb-21d09d668a46", "tag": "feb9d98a-c1aa-45cf-b1e3-06597d656e69"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:34:53.784749 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-4325302d-0160-4180-a005-e3412ba125ef req-b2c0ecbd-d7b8-472a-8f7d-ae9ef38b0c96 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:53.785398 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-4325302d-0160-4180-a005-e3412ba125ef req-b2c0ecbd-d7b8-472a-8f7d-ae9ef38b0c96 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:53.800702 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-4325302d-0160-4180-a005-e3412ba125ef req-b2c0ecbd-d7b8-472a-8f7d-ae9ef38b0c96 service nova] Creating event network-changed:feb9d98a-c1aa-45cf-b1e3-06597d656e69 for instance ab1f1412-017f-448b-a6bb-21d09d668a46 on hv-cinder-83602 Jun 30 16:34:53.806712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-4325302d-0160-4180-a005-e3412ba125ef req-b2c0ecbd-d7b8-472a-8f7d-ae9ef38b0c96 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037551 Jun 30 16:34:53.810865 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 81/171] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:34:54.195761 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7bd670db-a7f7-4daf-b835-c58d95ad4ed5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:54.197013 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7bd670db-a7f7-4daf-b835-c58d95ad4ed5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:54.215721 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7bd670db-a7f7-4daf-b835-c58d95ad4ed5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:54.215721 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7bd670db-a7f7-4daf-b835-c58d95ad4ed5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:54.217360 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7bd670db-a7f7-4daf-b835-c58d95ad4ed5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:54.218936 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7bd670db-a7f7-4daf-b835-c58d95ad4ed5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:54.481162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7bd670db-a7f7-4daf-b835-c58d95ad4ed5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:54.506367 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7bd670db-a7f7-4daf-b835-c58d95ad4ed5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.313379 Jun 30 16:34:54.508604 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 91/172] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:54 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:55.539527 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9e522ba8-6fe4-4991-905b-f4135186e405 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:55.542024 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9e522ba8-6fe4-4991-905b-f4135186e405 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:55.559127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9e522ba8-6fe4-4991-905b-f4135186e405 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:55.559889 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9e522ba8-6fe4-4991-905b-f4135186e405 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:55.561992 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9e522ba8-6fe4-4991-905b-f4135186e405 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:55.563071 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9e522ba8-6fe4-4991-905b-f4135186e405 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:55.840927 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9e522ba8-6fe4-4991-905b-f4135186e405 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:55.881659 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9e522ba8-6fe4-4991-905b-f4135186e405 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.352388 Jun 30 16:34:55.884502 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 82/173] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:55 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:34:56.908779 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4fa8227e-68a8-44a5-a1b5-0eb4ee607403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:56.910193 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4fa8227e-68a8-44a5-a1b5-0eb4ee607403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:56.923236 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4fa8227e-68a8-44a5-a1b5-0eb4ee607403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:56.924926 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4fa8227e-68a8-44a5-a1b5-0eb4ee607403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:56.926710 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4fa8227e-68a8-44a5-a1b5-0eb4ee607403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:56.928136 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4fa8227e-68a8-44a5-a1b5-0eb4ee607403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:57.212206 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4fa8227e-68a8-44a5-a1b5-0eb4ee607403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:57.224599 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-4fa8227e-68a8-44a5-a1b5-0eb4ee607403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.326162 Jun 30 16:34:57.225199 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 92/174] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:56 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:58.255934 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5765858b-86d5-4502-b26b-3edf8a09121f tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:58.256606 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5765858b-86d5-4502-b26b-3edf8a09121f tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:58.257357 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7c7f0e39-a2b9-40ab-8f47-c6689f4a643b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:58.258009 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-7c7f0e39-a2b9-40ab-8f47-c6689f4a643b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:58.271250 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5765858b-86d5-4502-b26b-3edf8a09121f tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:58.271736 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5765858b-86d5-4502-b26b-3edf8a09121f tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:58.272712 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5765858b-86d5-4502-b26b-3edf8a09121f tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:58.273318 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5765858b-86d5-4502-b26b-3edf8a09121f tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:58.273542 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7c7f0e39-a2b9-40ab-8f47-c6689f4a643b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:58.274081 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7c7f0e39-a2b9-40ab-8f47-c6689f4a643b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:58.276058 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7c7f0e39-a2b9-40ab-8f47-c6689f4a643b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:58.277273 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7c7f0e39-a2b9-40ab-8f47-c6689f4a643b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:58.312478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5765858b-86d5-4502-b26b-3edf8a09121f tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Going to try to terminate instance {{(pid=124814) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:34:58.473175 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-7c7f0e39-a2b9-40ab-8f47-c6689f4a643b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:58.483107 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7c7f0e39-a2b9-40ab-8f47-c6689f4a643b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.235379 Jun 30 16:34:58.483924 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 83/175] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:58 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:58.847848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5765858b-86d5-4502-b26b-3edf8a09121f tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "DELETE /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 204 len: 0 microversion: 2.1 time: 0.595345 Jun 30 16:34:58.848442 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 93/176] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:34:58 2022] DELETE /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 0 bytes in 597 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:34:58.857598 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1d2f225c-3ec5-425e-b13a-859a1896994a tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:58.858338 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1d2f225c-3ec5-425e-b13a-859a1896994a tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:58.866087 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1d2f225c-3ec5-425e-b13a-859a1896994a tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:58.866577 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1d2f225c-3ec5-425e-b13a-859a1896994a tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:58.867396 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1d2f225c-3ec5-425e-b13a-859a1896994a tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:58.867947 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1d2f225c-3ec5-425e-b13a-859a1896994a tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:59.162789 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1d2f225c-3ec5-425e-b13a-859a1896994a tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:59.172087 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1d2f225c-3ec5-425e-b13a-859a1896994a tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1551 microversion: 2.1 time: 0.318862 Jun 30 16:34:59.172676 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 84/177] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:58 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1551 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:34:59.504124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-290c4a00-e58d-46b3-90d3-73a147d9ed07 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:34:59.504968 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-290c4a00-e58d-46b3-90d3-73a147d9ed07 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:34:59.513103 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-290c4a00-e58d-46b3-90d3-73a147d9ed07 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:59.513737 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-290c4a00-e58d-46b3-90d3-73a147d9ed07 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:59.514499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-290c4a00-e58d-46b3-90d3-73a147d9ed07 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:34:59.515035 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-290c4a00-e58d-46b3-90d3-73a147d9ed07 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:34:59.675788 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-290c4a00-e58d-46b3-90d3-73a147d9ed07 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:34:59.683951 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-290c4a00-e58d-46b3-90d3-73a147d9ed07 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.184311 Jun 30 16:34:59.684543 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 94/178] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:34:59 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:00.194123 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d1a49f11-ef97-4a5a-8d2e-3f6971e25551 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:00.196199 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d1a49f11-ef97-4a5a-8d2e-3f6971e25551 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:00.203915 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d1a49f11-ef97-4a5a-8d2e-3f6971e25551 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:00.204449 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d1a49f11-ef97-4a5a-8d2e-3f6971e25551 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:00.218507 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d1a49f11-ef97-4a5a-8d2e-3f6971e25551 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:00.218507 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d1a49f11-ef97-4a5a-8d2e-3f6971e25551 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:00.377151 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d1a49f11-ef97-4a5a-8d2e-3f6971e25551 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:00.381213 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:35:00.389000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d1a49f11-ef97-4a5a-8d2e-3f6971e25551 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1551 microversion: 2.1 time: 0.202787 Jun 30 16:35:00.390732 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 85/179] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:00 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1551 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:00.700859 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-12eb913a-e5a8-4472-b7a2-ce8017cc06aa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:00.701971 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-12eb913a-e5a8-4472-b7a2-ce8017cc06aa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:00.709797 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12eb913a-e5a8-4472-b7a2-ce8017cc06aa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:00.710419 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12eb913a-e5a8-4472-b7a2-ce8017cc06aa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:00.711588 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12eb913a-e5a8-4472-b7a2-ce8017cc06aa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:00.712135 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12eb913a-e5a8-4472-b7a2-ce8017cc06aa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:00.894223 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-12eb913a-e5a8-4472-b7a2-ce8017cc06aa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:00.908361 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-12eb913a-e5a8-4472-b7a2-ce8017cc06aa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.211674 Jun 30 16:35:00.910916 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 95/180] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:00 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:01.416536 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1210cf4f-3004-438a-9d9b-5b4effb2474b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:01.417813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1210cf4f-3004-438a-9d9b-5b4effb2474b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:01.426754 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1210cf4f-3004-438a-9d9b-5b4effb2474b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:01.427965 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1210cf4f-3004-438a-9d9b-5b4effb2474b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:01.429075 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1210cf4f-3004-438a-9d9b-5b4effb2474b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:01.429521 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1210cf4f-3004-438a-9d9b-5b4effb2474b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:01.604393 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1210cf4f-3004-438a-9d9b-5b4effb2474b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:01.614449 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1210cf4f-3004-438a-9d9b-5b4effb2474b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1551 microversion: 2.1 time: 0.202008 Jun 30 16:35:01.615788 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 86/181] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:01 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1551 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:01.931513 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-58aa05eb-7a5b-4368-9ca5-1006c91fe290 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:01.938875 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-58aa05eb-7a5b-4368-9ca5-1006c91fe290 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:01.947204 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-58aa05eb-7a5b-4368-9ca5-1006c91fe290 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:01.949445 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-58aa05eb-7a5b-4368-9ca5-1006c91fe290 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:01.950452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-58aa05eb-7a5b-4368-9ca5-1006c91fe290 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:01.950992 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-58aa05eb-7a5b-4368-9ca5-1006c91fe290 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:02.056315 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-6b6b5527-ab42-455a-a67c-a005c1138f33 req-a7c4c3ba-c1ec-4fd2-bc8f-af5878327cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37aac043-7017-417e-a8dd-0a2619c5f38b", "name": "network-vif-deleted", "tag": "c270e4fc-eb23-4881-be9d-da7f4f37912e"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:35:02.067228 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-6b6b5527-ab42-455a-a67c-a005c1138f33 req-a7c4c3ba-c1ec-4fd2-bc8f-af5878327cfb service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:02.067709 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-6b6b5527-ab42-455a-a67c-a005c1138f33 req-a7c4c3ba-c1ec-4fd2-bc8f-af5878327cfb service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:02.092402 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-6b6b5527-ab42-455a-a67c-a005c1138f33 req-a7c4c3ba-c1ec-4fd2-bc8f-af5878327cfb service nova] Creating event network-vif-deleted:c270e4fc-eb23-4881-be9d-da7f4f37912e for instance 37aac043-7017-417e-a8dd-0a2619c5f38b on hv-cinder-83602 Jun 30 16:35:02.124974 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-6b6b5527-ab42-455a-a67c-a005c1138f33 req-a7c4c3ba-c1ec-4fd2-bc8f-af5878327cfb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065490 Jun 30 16:35:02.126609 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 87/182] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:35:02.213277 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-58aa05eb-7a5b-4368-9ca5-1006c91fe290 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:02.223128 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-58aa05eb-7a5b-4368-9ca5-1006c91fe290 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.295540 Jun 30 16:35:02.224233 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 96/183] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:01 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:02.638245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d29cbb12-117d-4e6e-afa7-6dca4af762ae tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:02.639262 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d29cbb12-117d-4e6e-afa7-6dca4af762ae tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:02.648482 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d29cbb12-117d-4e6e-afa7-6dca4af762ae tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:02.649541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d29cbb12-117d-4e6e-afa7-6dca4af762ae tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:02.651404 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d29cbb12-117d-4e6e-afa7-6dca4af762ae tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:02.652168 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d29cbb12-117d-4e6e-afa7-6dca4af762ae tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:02.756742 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d29cbb12-117d-4e6e-afa7-6dca4af762ae tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:02.766950 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d29cbb12-117d-4e6e-afa7-6dca4af762ae tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1344 microversion: 2.1 time: 0.134111 Jun 30 16:35:02.768783 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 88/184] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:02 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1344 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:03.244669 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c025a8a5-3985-4f5e-972a-e82ad22dd738 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:03.245209 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c025a8a5-3985-4f5e-972a-e82ad22dd738 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:03.251455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c025a8a5-3985-4f5e-972a-e82ad22dd738 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:03.251934 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c025a8a5-3985-4f5e-972a-e82ad22dd738 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:03.252706 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c025a8a5-3985-4f5e-972a-e82ad22dd738 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:03.253142 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c025a8a5-3985-4f5e-972a-e82ad22dd738 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:03.256009 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:35:03.423198 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c025a8a5-3985-4f5e-972a-e82ad22dd738 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:03.439556 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c025a8a5-3985-4f5e-972a-e82ad22dd738 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.198732 Jun 30 16:35:03.440624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 97/185] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:03 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:03.787552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-41f11969-587d-4de8-a3a1-80c8a9a10054 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:03.788597 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-41f11969-587d-4de8-a3a1-80c8a9a10054 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:03.796806 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-41f11969-587d-4de8-a3a1-80c8a9a10054 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:03.797410 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-41f11969-587d-4de8-a3a1-80c8a9a10054 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:03.798484 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-41f11969-587d-4de8-a3a1-80c8a9a10054 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:03.801090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-41f11969-587d-4de8-a3a1-80c8a9a10054 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:03.840351 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-41f11969-587d-4de8-a3a1-80c8a9a10054 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:03.841161 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-41f11969-587d-4de8-a3a1-80c8a9a10054 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:03.841850 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-41f11969-587d-4de8-a3a1-80c8a9a10054 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lazy-loading 'fault' on Instance uuid 37aac043-7017-417e-a8dd-0a2619c5f38b {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:35:03.900740 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-41f11969-587d-4de8-a3a1-80c8a9a10054 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5703438f487a45abbc5b68b77519534c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2da3dc7978d5414cba40e9e08dc39d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:03.911131 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-41f11969-587d-4de8-a3a1-80c8a9a10054 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 200 len: 1349 microversion: 2.1 time: 0.129493 Jun 30 16:35:03.911778 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 89/186] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:03 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 1349 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:04.465067 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4980b54e-d6ff-4645-bfd8-d09213cc4957 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:04.465731 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4980b54e-d6ff-4645-bfd8-d09213cc4957 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:04.476339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4980b54e-d6ff-4645-bfd8-d09213cc4957 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:04.477565 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4980b54e-d6ff-4645-bfd8-d09213cc4957 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:04.478459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4980b54e-d6ff-4645-bfd8-d09213cc4957 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:04.479680 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4980b54e-d6ff-4645-bfd8-d09213cc4957 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:04.659708 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4980b54e-d6ff-4645-bfd8-d09213cc4957 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:04.667798 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-4980b54e-d6ff-4645-bfd8-d09213cc4957 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.206654 Jun 30 16:35:04.668408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 98/187] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:04 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:04.935091 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-37a91f72-301f-434a-9ecd-0302a55f7f73 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:04.936181 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-37a91f72-301f-434a-9ecd-0302a55f7f73 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:04.946875 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-37a91f72-301f-434a-9ecd-0302a55f7f73 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:04.947693 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-37a91f72-301f-434a-9ecd-0302a55f7f73 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:04.948934 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-37a91f72-301f-434a-9ecd-0302a55f7f73 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:04.949663 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-37a91f72-301f-434a-9ecd-0302a55f7f73 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:04.970632 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-37a91f72-301f-434a-9ecd-0302a55f7f73 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] HTTP exception thrown: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-37a91f72-301f-434a-9ecd-0302a55f7f73 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Request method failure captured: Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b HTTP/1.1 Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdBumL7hlV_V8IsjyjDZCkkU6O3JXHwvFP2Owsvodec87WZmjikF4gc9a4Ze7bEobZTAAQE25IvWt8cplVKjlpEDPxlbvQKRO-5aDVp9i1kKxsfTQGr9HaqT4P_iKighE7sFeCuEh_3zxqooVm_T8suN2hd25LqSFEs3zFVgBcaqiWQ Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: 2da3dc7978d5414cba40e9e08dc39d94 Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-DeleteServersTestJSON-1770197449 Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:35:04.975973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:35:04.978576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2da3dc7978d5414cba40e9e08dc39d94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2da3dc7978d5414cba40e9e08dc39d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2da3dc7978d5414cba40e9e08dc39d94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2da3dc7978d5414cba40e9e08dc39d94"}]}] Jun 30 16:35:04.978576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-DeleteServersTestJSON-1770197449 Jun 30 16:35:04.978576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: 2da3dc7978d5414cba40e9e08dc39d94 Jun 30 16:35:04.978576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-DeleteServersTestJSON-1770197449 Jun 30 16:35:04.978576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-DeleteServersTestJSON-1770197449-project Jun 30 16:35:04.978576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:35:04.978576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:35:04.978576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 5703438f487a45abbc5b68b77519534c Jun 30 16:35:04.978576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-DeleteServersTestJSON-1770197449-project Jun 30 16:35:04.978576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:35:04.978576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:04.978576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': '37aac043-7017-417e-a8dd-0a2619c5f38b'} Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:35:04.979946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:04.981954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:35:04.983901 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-37a91f72-301f-434a-9ecd-0302a55f7f73 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Returning 404 to user: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:35:04.983901 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-37a91f72-301f-434a-9ecd-0302a55f7f73 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 404 len: 111 microversion: 2.1 time: 0.052096 Jun 30 16:35:04.983901 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 90/188] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:04 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:35:05.151233 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-974b81f7-c897-4cc1-b3d5-a15fae499d6c tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:05.152798 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-974b81f7-c897-4cc1-b3d5-a15fae499d6c tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:05.160376 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-974b81f7-c897-4cc1-b3d5-a15fae499d6c tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:05.160828 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-974b81f7-c897-4cc1-b3d5-a15fae499d6c tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:05.161633 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-974b81f7-c897-4cc1-b3d5-a15fae499d6c tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:05.162071 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-974b81f7-c897-4cc1-b3d5-a15fae499d6c tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:05.177011 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-974b81f7-c897-4cc1-b3d5-a15fae499d6c tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] HTTP exception thrown: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-974b81f7-c897-4cc1-b3d5-a15fae499d6c tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Request method failure captured: Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b/os-volume_attachments HTTP/1.1 Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdBumL7hlV_V8IsjyjDZCkkU6O3JXHwvFP2Owsvodec87WZmjikF4gc9a4Ze7bEobZTAAQE25IvWt8cplVKjlpEDPxlbvQKRO-5aDVp9i1kKxsfTQGr9HaqT4P_iKighE7sFeCuEh_3zxqooVm_T8suN2hd25LqSFEs3zFVgBcaqiWQ Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 2da3dc7978d5414cba40e9e08dc39d94 Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-DeleteServersTestJSON-1770197449 Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:35:05.181365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:35:05.182976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2da3dc7978d5414cba40e9e08dc39d94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2da3dc7978d5414cba40e9e08dc39d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2da3dc7978d5414cba40e9e08dc39d94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2da3dc7978d5414cba40e9e08dc39d94"}]}] Jun 30 16:35:05.182976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-DeleteServersTestJSON-1770197449 Jun 30 16:35:05.182976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 2da3dc7978d5414cba40e9e08dc39d94 Jun 30 16:35:05.182976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-DeleteServersTestJSON-1770197449 Jun 30 16:35:05.182976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-DeleteServersTestJSON-1770197449-project Jun 30 16:35:05.182976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:35:05.182976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:35:05.182976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 5703438f487a45abbc5b68b77519534c Jun 30 16:35:05.182976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-DeleteServersTestJSON-1770197449-project Jun 30 16:35:05.182976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:35:05.182976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:05.182976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'server_id': '37aac043-7017-417e-a8dd-0a2619c5f38b'} Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:35:05.183869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:05.185127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:05.186406 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-974b81f7-c897-4cc1-b3d5-a15fae499d6c tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Returning 404 to user: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:35:05.186406 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-974b81f7-c897-4cc1-b3d5-a15fae499d6c tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036706 Jun 30 16:35:05.186406 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 99/189] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:35:05 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:35:05.685766 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-5e10a21c-6dc5-4b03-bef9-d4605c26f78e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:05.686392 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-5e10a21c-6dc5-4b03-bef9-d4605c26f78e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:05.692833 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5e10a21c-6dc5-4b03-bef9-d4605c26f78e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:05.693290 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5e10a21c-6dc5-4b03-bef9-d4605c26f78e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:05.694081 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5e10a21c-6dc5-4b03-bef9-d4605c26f78e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:05.694520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5e10a21c-6dc5-4b03-bef9-d4605c26f78e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:05.847442 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5e10a21c-6dc5-4b03-bef9-d4605c26f78e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:05.859113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-5e10a21c-6dc5-4b03-bef9-d4605c26f78e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.174084 Jun 30 16:35:05.859113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 91/190] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:05 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:06.761567 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2548e5f5-868b-4be1-97f6-524882b64c8b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:06.762368 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2548e5f5-868b-4be1-97f6-524882b64c8b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:06.768847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2548e5f5-868b-4be1-97f6-524882b64c8b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:06.769618 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2548e5f5-868b-4be1-97f6-524882b64c8b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:06.770404 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2548e5f5-868b-4be1-97f6-524882b64c8b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:06.770834 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2548e5f5-868b-4be1-97f6-524882b64c8b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:06.786465 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-2548e5f5-868b-4be1-97f6-524882b64c8b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] HTTP exception thrown: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2548e5f5-868b-4be1-97f6-524882b64c8b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Request method failure captured: Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: DELETE /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b HTTP/1.1 Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdBumL7hlV_V8IsjyjDZCkkU6O3JXHwvFP2Owsvodec87WZmjikF4gc9a4Ze7bEobZTAAQE25IvWt8cplVKjlpEDPxlbvQKRO-5aDVp9i1kKxsfTQGr9HaqT4P_iKighE7sFeCuEh_3zxqooVm_T8suN2hd25LqSFEs3zFVgBcaqiWQ Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 2da3dc7978d5414cba40e9e08dc39d94 Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-DeleteServersTestJSON-1770197449 Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:35:06.788818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:35:06.791353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2da3dc7978d5414cba40e9e08dc39d94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2da3dc7978d5414cba40e9e08dc39d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2da3dc7978d5414cba40e9e08dc39d94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2da3dc7978d5414cba40e9e08dc39d94"}]}] Jun 30 16:35:06.791353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-DeleteServersTestJSON-1770197449 Jun 30 16:35:06.791353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 2da3dc7978d5414cba40e9e08dc39d94 Jun 30 16:35:06.791353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-DeleteServersTestJSON-1770197449 Jun 30 16:35:06.791353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-DeleteServersTestJSON-1770197449-project Jun 30 16:35:06.791353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:35:06.791353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:35:06.791353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 5703438f487a45abbc5b68b77519534c Jun 30 16:35:06.791353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-DeleteServersTestJSON-1770197449-project Jun 30 16:35:06.791353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:35:06.791353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:06.791353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': '37aac043-7017-417e-a8dd-0a2619c5f38b'} Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:35:06.792889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:06.795272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:06.798032 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2548e5f5-868b-4be1-97f6-524882b64c8b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Returning 404 to user: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:35:06.798032 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2548e5f5-868b-4be1-97f6-524882b64c8b tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "DELETE /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 404 len: 111 microversion: 2.1 time: 0.032998 Jun 30 16:35:06.798032 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 100/191] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:35:06 2022] DELETE /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 16:35:06.802954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b0f40ab4-d20d-4ceb-8009-4e5bb777bf75 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:06.802954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b0f40ab4-d20d-4ceb-8009-4e5bb777bf75 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] [instance: 37aac043-7017-417e-a8dd-0a2619c5f38b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:06.809726 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b0f40ab4-d20d-4ceb-8009-4e5bb777bf75 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:06.810188 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b0f40ab4-d20d-4ceb-8009-4e5bb777bf75 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:06.813923 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b0f40ab4-d20d-4ceb-8009-4e5bb777bf75 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:06.813923 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b0f40ab4-d20d-4ceb-8009-4e5bb777bf75 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:06.827255 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-b0f40ab4-d20d-4ceb-8009-4e5bb777bf75 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] HTTP exception thrown: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b0f40ab4-d20d-4ceb-8009-4e5bb777bf75 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Request method failure captured: Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b HTTP/1.1 Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdBumL7hlV_V8IsjyjDZCkkU6O3JXHwvFP2Owsvodec87WZmjikF4gc9a4Ze7bEobZTAAQE25IvWt8cplVKjlpEDPxlbvQKRO-5aDVp9i1kKxsfTQGr9HaqT4P_iKighE7sFeCuEh_3zxqooVm_T8suN2hd25LqSFEs3zFVgBcaqiWQ Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: 2da3dc7978d5414cba40e9e08dc39d94 Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-DeleteServersTestJSON-1770197449 Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:35:06.828744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:35:06.836192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2da3dc7978d5414cba40e9e08dc39d94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/2da3dc7978d5414cba40e9e08dc39d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_2da3dc7978d5414cba40e9e08dc39d94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/2da3dc7978d5414cba40e9e08dc39d94"}]}] Jun 30 16:35:06.836192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-DeleteServersTestJSON-1770197449 Jun 30 16:35:06.836192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: 2da3dc7978d5414cba40e9e08dc39d94 Jun 30 16:35:06.836192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-DeleteServersTestJSON-1770197449 Jun 30 16:35:06.836192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-DeleteServersTestJSON-1770197449-project Jun 30 16:35:06.836192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:35:06.836192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:35:06.836192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 5703438f487a45abbc5b68b77519534c Jun 30 16:35:06.836192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-DeleteServersTestJSON-1770197449-project Jun 30 16:35:06.836192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:35:06.836192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:06.836192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': '37aac043-7017-417e-a8dd-0a2619c5f38b'} Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:35:06.840395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. Jun 30 16:35:06.843736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:35:06.845886 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b0f40ab4-d20d-4ceb-8009-4e5bb777bf75 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] Returning 404 to user: Instance 37aac043-7017-417e-a8dd-0a2619c5f38b could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:35:06.845886 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b0f40ab4-d20d-4ceb-8009-4e5bb777bf75 tempest-DeleteServersTestJSON-1770197449 tempest-DeleteServersTestJSON-1770197449-project] 10.222.0.67 "GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b" status: 404 len: 111 microversion: 2.1 time: 0.034930 Jun 30 16:35:06.845886 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 92/192] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:06 2022] GET /compute/v2.1/servers/37aac043-7017-417e-a8dd-0a2619c5f38b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:35:06.875518 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ae0fabd2-8b3d-4d75-aeb2-96448bbc3b7c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:06.877060 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ae0fabd2-8b3d-4d75-aeb2-96448bbc3b7c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:06.887134 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ae0fabd2-8b3d-4d75-aeb2-96448bbc3b7c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:06.887758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ae0fabd2-8b3d-4d75-aeb2-96448bbc3b7c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:06.888673 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ae0fabd2-8b3d-4d75-aeb2-96448bbc3b7c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:06.889585 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ae0fabd2-8b3d-4d75-aeb2-96448bbc3b7c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:07.191986 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ae0fabd2-8b3d-4d75-aeb2-96448bbc3b7c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:07.200547 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ae0fabd2-8b3d-4d75-aeb2-96448bbc3b7c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.329438 Jun 30 16:35:07.202424 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 101/193] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:06 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:35:08.226745 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-50e97cee-070a-47f1-a5bf-d8f5efc54807 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:08.227363 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-50e97cee-070a-47f1-a5bf-d8f5efc54807 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:08.234968 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-50e97cee-070a-47f1-a5bf-d8f5efc54807 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:08.235590 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-50e97cee-070a-47f1-a5bf-d8f5efc54807 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:08.236378 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-50e97cee-070a-47f1-a5bf-d8f5efc54807 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:08.236812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-50e97cee-070a-47f1-a5bf-d8f5efc54807 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:08.472515 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-50e97cee-070a-47f1-a5bf-d8f5efc54807 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:08.487050 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-50e97cee-070a-47f1-a5bf-d8f5efc54807 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.264111 Jun 30 16:35:08.488099 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 93/194] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:08 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:09.506128 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d8f1a489-c25c-4f94-b543-d358673834eb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:09.507760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d8f1a489-c25c-4f94-b543-d358673834eb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:09.513568 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d8f1a489-c25c-4f94-b543-d358673834eb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:09.514018 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d8f1a489-c25c-4f94-b543-d358673834eb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:09.514817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d8f1a489-c25c-4f94-b543-d358673834eb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:09.515250 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d8f1a489-c25c-4f94-b543-d358673834eb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:09.804412 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d8f1a489-c25c-4f94-b543-d358673834eb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:09.813515 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d8f1a489-c25c-4f94-b543-d358673834eb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.312490 Jun 30 16:35:09.814206 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 102/195] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:09 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:10.835644 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-85d79a25-5ff2-43c5-9db9-03c55b4bdd88 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:10.837155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-85d79a25-5ff2-43c5-9db9-03c55b4bdd88 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:10.847454 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-85d79a25-5ff2-43c5-9db9-03c55b4bdd88 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:10.848344 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-85d79a25-5ff2-43c5-9db9-03c55b4bdd88 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:10.849429 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-85d79a25-5ff2-43c5-9db9-03c55b4bdd88 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:10.850436 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-85d79a25-5ff2-43c5-9db9-03c55b4bdd88 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:11.072534 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-85d79a25-5ff2-43c5-9db9-03c55b4bdd88 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:11.081891 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-85d79a25-5ff2-43c5-9db9-03c55b4bdd88 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.255368 Jun 30 16:35:11.082662 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 94/196] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:10 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:12.109160 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-cd6d7986-a1c7-4524-8706-f8fdbb7c112f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:12.109821 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-cd6d7986-a1c7-4524-8706-f8fdbb7c112f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:12.123809 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cd6d7986-a1c7-4524-8706-f8fdbb7c112f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:12.125499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cd6d7986-a1c7-4524-8706-f8fdbb7c112f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:12.126345 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cd6d7986-a1c7-4524-8706-f8fdbb7c112f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:12.126792 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cd6d7986-a1c7-4524-8706-f8fdbb7c112f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:12.543240 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-cd6d7986-a1c7-4524-8706-f8fdbb7c112f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:12.552286 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-cd6d7986-a1c7-4524-8706-f8fdbb7c112f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.447000 Jun 30 16:35:12.553203 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 103/197] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:12 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:35:13.569816 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6c024059-a706-4389-b486-7468526e4e7e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:13.570464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6c024059-a706-4389-b486-7468526e4e7e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:13.579659 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6c024059-a706-4389-b486-7468526e4e7e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:13.580471 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6c024059-a706-4389-b486-7468526e4e7e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:13.582194 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6c024059-a706-4389-b486-7468526e4e7e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:13.582936 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6c024059-a706-4389-b486-7468526e4e7e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:13.779236 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6c024059-a706-4389-b486-7468526e4e7e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:13.788835 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6c024059-a706-4389-b486-7468526e4e7e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.222917 Jun 30 16:35:13.789435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 95/198] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:13 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:14.806947 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-871bffee-1229-47f0-b4fc-36ba835efec6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:14.807871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-871bffee-1229-47f0-b4fc-36ba835efec6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:14.809866 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:35:14.814841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-871bffee-1229-47f0-b4fc-36ba835efec6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:14.815293 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-871bffee-1229-47f0-b4fc-36ba835efec6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:14.816181 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-871bffee-1229-47f0-b4fc-36ba835efec6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:14.816691 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-871bffee-1229-47f0-b4fc-36ba835efec6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:15.010035 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-871bffee-1229-47f0-b4fc-36ba835efec6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:15.029846 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-871bffee-1229-47f0-b4fc-36ba835efec6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.227213 Jun 30 16:35:15.030781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 104/199] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:14 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:16.048929 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-77814fce-69c4-4d0c-b74e-5387b620e640 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:16.049582 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-77814fce-69c4-4d0c-b74e-5387b620e640 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:16.052333 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=53 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:35:16.057181 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-77814fce-69c4-4d0c-b74e-5387b620e640 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:16.057643 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-77814fce-69c4-4d0c-b74e-5387b620e640 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:16.058416 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-77814fce-69c4-4d0c-b74e-5387b620e640 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:16.058861 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-77814fce-69c4-4d0c-b74e-5387b620e640 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:16.206329 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-77814fce-69c4-4d0c-b74e-5387b620e640 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:16.214618 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-77814fce-69c4-4d0c-b74e-5387b620e640 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.170346 Jun 30 16:35:16.215192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 96/200] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:16 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:17.232252 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3298a9d0-11bd-4529-834d-2bc44c351b00 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:17.232933 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3298a9d0-11bd-4529-834d-2bc44c351b00 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:17.240232 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3298a9d0-11bd-4529-834d-2bc44c351b00 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:17.240319 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3298a9d0-11bd-4529-834d-2bc44c351b00 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:17.241077 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3298a9d0-11bd-4529-834d-2bc44c351b00 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:17.241531 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3298a9d0-11bd-4529-834d-2bc44c351b00 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:17.389979 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3298a9d0-11bd-4529-834d-2bc44c351b00 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:17.398262 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3298a9d0-11bd-4529-834d-2bc44c351b00 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.170126 Jun 30 16:35:17.398842 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 105/201] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:17 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:17.539775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-96fd5b9f-1b07-4939-b18a-b226ed02aeb7 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] Calling method '.version_select at 0x7f38204a1af0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:17.594221 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-96fd5b9f-1b07-4939-b18a-b226ed02aeb7 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/0281c028-ea41-4a1e-bbbd-1a2aa0828563" status: 200 len: 350 microversion: 2.1 time: 0.057710 Jun 30 16:35:17.594221 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 97/202] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 30 16:35:17 2022] GET /compute/v2.1/os-volumes/0281c028-ea41-4a1e-bbbd-1a2aa0828563 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:35:18.419618 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1adcc8a2-6a31-478b-a0f4-1facd1e79e4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:18.420272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-1adcc8a2-6a31-478b-a0f4-1facd1e79e4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:18.427926 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1adcc8a2-6a31-478b-a0f4-1facd1e79e4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:18.430587 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1adcc8a2-6a31-478b-a0f4-1facd1e79e4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:18.432621 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1adcc8a2-6a31-478b-a0f4-1facd1e79e4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:18.433385 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1adcc8a2-6a31-478b-a0f4-1facd1e79e4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:18.597693 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-1adcc8a2-6a31-478b-a0f4-1facd1e79e4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:18.606543 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-1adcc8a2-6a31-478b-a0f4-1facd1e79e4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.192641 Jun 30 16:35:18.609016 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 106/203] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:18 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:19.632293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-96fa4fd2-bd70-4265-8084-641402f3aa7b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:19.632828 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-96fa4fd2-bd70-4265-8084-641402f3aa7b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:19.638896 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-96fa4fd2-bd70-4265-8084-641402f3aa7b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:19.639347 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-96fa4fd2-bd70-4265-8084-641402f3aa7b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:19.640163 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-96fa4fd2-bd70-4265-8084-641402f3aa7b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:19.640612 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-96fa4fd2-bd70-4265-8084-641402f3aa7b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:19.781332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-96fa4fd2-bd70-4265-8084-641402f3aa7b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:19.789095 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-96fa4fd2-bd70-4265-8084-641402f3aa7b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.161914 Jun 30 16:35:19.789667 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 98/204] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:19 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:20.807174 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-07589ea0-8108-4927-a680-67ebf95145bb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:20.807752 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-07589ea0-8108-4927-a680-67ebf95145bb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:20.814480 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-07589ea0-8108-4927-a680-67ebf95145bb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:20.814933 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-07589ea0-8108-4927-a680-67ebf95145bb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:20.815755 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-07589ea0-8108-4927-a680-67ebf95145bb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:20.816198 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-07589ea0-8108-4927-a680-67ebf95145bb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:20.961841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-07589ea0-8108-4927-a680-67ebf95145bb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:20.969342 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-07589ea0-8108-4927-a680-67ebf95145bb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.166816 Jun 30 16:35:20.969978 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 107/205] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:20 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:35:21.986598 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e503b8f6-de1a-443d-af03-081a639b51a6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:21.987152 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e503b8f6-de1a-443d-af03-081a639b51a6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:21.994840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e503b8f6-de1a-443d-af03-081a639b51a6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:21.995309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e503b8f6-de1a-443d-af03-081a639b51a6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:21.996118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e503b8f6-de1a-443d-af03-081a639b51a6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:21.996564 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e503b8f6-de1a-443d-af03-081a639b51a6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:22.133150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e503b8f6-de1a-443d-af03-081a639b51a6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:22.140815 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e503b8f6-de1a-443d-af03-081a639b51a6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.158551 Jun 30 16:35:22.141379 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 99/206] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:21 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:22.554843 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e013f005-0760-40d1-b6cf-441492cfbac2 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] Calling method '.version_select at 0x7f3820394040>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:22.616998 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e013f005-0760-40d1-b6cf-441492cfbac2 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/54be19b4-73fd-4269-8fcb-046e2b8426ab" status: 200 len: 350 microversion: 2.1 time: 0.065915 Jun 30 16:35:22.617636 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 108/207] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 30 16:35:22 2022] GET /compute/v2.1/os-volumes/54be19b4-73fd-4269-8fcb-046e2b8426ab => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:35:23.160049 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-224d4160-80f6-4795-8914-da1e6cde8e38 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:23.160680 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-224d4160-80f6-4795-8914-da1e6cde8e38 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:23.168069 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-224d4160-80f6-4795-8914-da1e6cde8e38 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:23.168512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-224d4160-80f6-4795-8914-da1e6cde8e38 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:23.169289 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-224d4160-80f6-4795-8914-da1e6cde8e38 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:23.169726 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-224d4160-80f6-4795-8914-da1e6cde8e38 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:23.348372 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-224d4160-80f6-4795-8914-da1e6cde8e38 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:23.357551 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-224d4160-80f6-4795-8914-da1e6cde8e38 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1519 microversion: 2.1 time: 0.202893 Jun 30 16:35:23.358523 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 100/208] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:23 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:24.375011 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2ed7e2e9-edb6-4378-ae1c-aeff621f4e50 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:24.375763 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2ed7e2e9-edb6-4378-ae1c-aeff621f4e50 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:24.384068 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2ed7e2e9-edb6-4378-ae1c-aeff621f4e50 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:24.384701 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2ed7e2e9-edb6-4378-ae1c-aeff621f4e50 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:24.385702 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2ed7e2e9-edb6-4378-ae1c-aeff621f4e50 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:24.386407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2ed7e2e9-edb6-4378-ae1c-aeff621f4e50 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:24.552042 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2ed7e2e9-edb6-4378-ae1c-aeff621f4e50 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:24.562366 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2ed7e2e9-edb6-4378-ae1c-aeff621f4e50 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1499 microversion: 2.1 time: 0.191813 Jun 30 16:35:24.563127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 109/209] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:24 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1499 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:24.580657 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-3faa8784-1b57-4086-adc7-6a563ca3905a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:24.581258 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-3faa8784-1b57-4086-adc7-6a563ca3905a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:24.589363 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3faa8784-1b57-4086-adc7-6a563ca3905a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:24.589835 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3faa8784-1b57-4086-adc7-6a563ca3905a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:24.590593 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3faa8784-1b57-4086-adc7-6a563ca3905a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:24.591030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3faa8784-1b57-4086-adc7-6a563ca3905a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:24.739001 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-3faa8784-1b57-4086-adc7-6a563ca3905a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:24.747520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-3faa8784-1b57-4086-adc7-6a563ca3905a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1514 microversion: 2.1 time: 0.170557 Jun 30 16:35:24.748521 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 101/210] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:24 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:27.650969 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ae9fbf51-90a9-4976-af45-c675af4fbe55 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:35:27.651978 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ae9fbf51-90a9-4976-af45-c675af4fbe55 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:27.658554 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ae9fbf51-90a9-4976-af45-c675af4fbe55 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:27.658999 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ae9fbf51-90a9-4976-af45-c675af4fbe55 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:27.659804 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ae9fbf51-90a9-4976-af45-c675af4fbe55 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:27.660243 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ae9fbf51-90a9-4976-af45-c675af4fbe55 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:27.683544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-ae9fbf51-90a9-4976-af45-c675af4fbe55 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lazy-loading 'flavor' on Instance uuid 6ce60666-aa28-4c5d-b893-faa7f10a777b {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:35:27.933136 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-fe571f76-4a4b-424e-80ef-431a8e34f457 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] Calling method '.version_select at 0x7f382036e5e0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:27.984212 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-fe571f76-4a4b-424e-80ef-431a8e34f457 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/a9bbcc0f-1f32-4567-a567-6aaa036911ee" status: 200 len: 351 microversion: 2.1 time: 0.055486 Jun 30 16:35:27.984803 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 102/211] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 30 16:35:27 2022] GET /compute/v2.1/os-volumes/a9bbcc0f-1f32-4567-a567-6aaa036911ee => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:35:27.996876 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-3450beff-2a1a-4c51-88a5-a8305096c4a5 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] Calling method '.version_select at 0x7f3820374550>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:28.088270 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-3450beff-2a1a-4c51-88a5-a8305096c4a5 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.095166 Jun 30 16:35:28.088837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 103/212] 10.222.0.67 () {58 vars in 1133 bytes} [Thu Jun 30 16:35:27 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:35:28.104182 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ae9fbf51-90a9-4976-af45-c675af4fbe55 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "POST /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b/action" status: 200 len: 32 microversion: 2.1 time: 0.457814 Jun 30 16:35:28.110365 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-062b4132-8205-42c1-8a20-82ff528886da tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] Calling method '.version_select at 0x7f38205d61f0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:28.110510 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 110/213] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 30 16:35:27 2022] POST /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b/action => generated 32 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 16:35:28.120880 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9a6290d7-80a4-4016-8366-907c5fb661e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:28.127352 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9a6290d7-80a4-4016-8366-907c5fb661e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:28.139086 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9a6290d7-80a4-4016-8366-907c5fb661e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:28.139847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9a6290d7-80a4-4016-8366-907c5fb661e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:28.140799 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9a6290d7-80a4-4016-8366-907c5fb661e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:28.141428 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9a6290d7-80a4-4016-8366-907c5fb661e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:28.214577 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-062b4132-8205-42c1-8a20-82ff528886da tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.114601 Jun 30 16:35:28.215197 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 104/214] 10.222.0.67 () {58 vars in 1148 bytes} [Thu Jun 30 16:35:28 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:35:28.230559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7964da8b-af7b-465f-b321-0b7a042e97db tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] Calling method '.version_select at 0x7f382047b550>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:28.313721 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9a6290d7-80a4-4016-8366-907c5fb661e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:28.324092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9a6290d7-80a4-4016-8366-907c5fb661e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.211620 Jun 30 16:35:28.336781 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7964da8b-af7b-465f-b321-0b7a042e97db tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.113129 Jun 30 16:35:28.337358 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 105/215] 10.222.0.67 () {58 vars in 1133 bytes} [Thu Jun 30 16:35:28 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:28.337671 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 111/216] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:28 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:28.353593 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-54838519-adea-4793-9fcc-00ba483ef0b1 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] Calling method '.version_select at 0x7f38204a1280>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:28.443060 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-54838519-adea-4793-9fcc-00ba483ef0b1 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.095133 Jun 30 16:35:28.443677 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 106/217] 10.222.0.67 () {58 vars in 1166 bytes} [Thu Jun 30 16:35:28 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:35:28.455198 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-485690f0-137b-45c4-986b-9735d6bc5d93 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] Calling method '.version_select at 0x7f3820394f70>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:28.543894 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-485690f0-137b-45c4-986b-9735d6bc5d93 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.092512 Jun 30 16:35:28.544730 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 112/218] 10.222.0.67 () {58 vars in 1169 bytes} [Thu Jun 30 16:35:28 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:35:28.558557 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-141952b7-2c7b-4962-a448-0bce3adbccd4 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] Calling method '.version_select at 0x7f382036eca0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:28.652539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-141952b7-2c7b-4962-a448-0bce3adbccd4 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.099796 Jun 30 16:35:28.653110 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 107/219] 10.222.0.67 () {58 vars in 1154 bytes} [Thu Jun 30 16:35:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:35:28.664789 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a36197cc-5fb6-4feb-bd26-fd0fd2250f49 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] Calling method '.version_select at 0x7f38203ee1f0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:28.756614 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a36197cc-5fb6-4feb-bd26-fd0fd2250f49 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.093523 Jun 30 16:35:28.756614 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 113/220] 10.222.0.67 () {58 vars in 1187 bytes} [Thu Jun 30 16:35:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:35:28.768174 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c7316574-b1a1-472b-8c8d-b27883be26c6 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] Calling method '.version_select at 0x7f382036e1f0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:28.880796 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c7316574-b1a1-472b-8c8d-b27883be26c6 tempest-VolumesTestJSON-360133139 tempest-VolumesTestJSON-360133139-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.117325 Jun 30 16:35:28.881485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 108/221] 10.222.0.67 () {58 vars in 1154 bytes} [Thu Jun 30 16:35:28 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:29.342849 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3b6b22c7-f303-46a9-bea5-a3bb7dabe62a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:29.343497 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3b6b22c7-f303-46a9-bea5-a3bb7dabe62a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:29.353809 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3b6b22c7-f303-46a9-bea5-a3bb7dabe62a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:29.354729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3b6b22c7-f303-46a9-bea5-a3bb7dabe62a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:29.356241 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3b6b22c7-f303-46a9-bea5-a3bb7dabe62a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:29.356962 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3b6b22c7-f303-46a9-bea5-a3bb7dabe62a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:29.537035 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3b6b22c7-f303-46a9-bea5-a3bb7dabe62a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:29.546072 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3b6b22c7-f303-46a9-bea5-a3bb7dabe62a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.207233 Jun 30 16:35:29.546666 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 114/222] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:29 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:30.566823 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b18d97d1-11e9-47e7-9c0d-c02f831b7828 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:30.567449 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b18d97d1-11e9-47e7-9c0d-c02f831b7828 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:30.578407 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b18d97d1-11e9-47e7-9c0d-c02f831b7828 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:30.579236 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b18d97d1-11e9-47e7-9c0d-c02f831b7828 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:30.580417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b18d97d1-11e9-47e7-9c0d-c02f831b7828 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:30.581144 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b18d97d1-11e9-47e7-9c0d-c02f831b7828 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:30.746957 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b18d97d1-11e9-47e7-9c0d-c02f831b7828 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:30.755226 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b18d97d1-11e9-47e7-9c0d-c02f831b7828 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.192706 Jun 30 16:35:30.755931 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 109/223] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:30 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:31.773145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c52756bd-5103-4bab-9022-bf9757e50ccb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:31.774750 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c52756bd-5103-4bab-9022-bf9757e50ccb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:31.782128 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c52756bd-5103-4bab-9022-bf9757e50ccb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:31.782843 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c52756bd-5103-4bab-9022-bf9757e50ccb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:31.783675 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c52756bd-5103-4bab-9022-bf9757e50ccb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:31.784117 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c52756bd-5103-4bab-9022-bf9757e50ccb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:31.934865 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c52756bd-5103-4bab-9022-bf9757e50ccb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:31.949240 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c52756bd-5103-4bab-9022-bf9757e50ccb tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.179823 Jun 30 16:35:31.949926 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 115/224] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:31 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:32.972301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9384cba1-2f63-46ef-9a99-d988429562db tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:32.973759 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9384cba1-2f63-46ef-9a99-d988429562db tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:32.982733 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9384cba1-2f63-46ef-9a99-d988429562db tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:32.983195 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9384cba1-2f63-46ef-9a99-d988429562db tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:32.984026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9384cba1-2f63-46ef-9a99-d988429562db tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:32.984474 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9384cba1-2f63-46ef-9a99-d988429562db tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:33.148578 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9384cba1-2f63-46ef-9a99-d988429562db tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:33.157471 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9384cba1-2f63-46ef-9a99-d988429562db tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.195013 Jun 30 16:35:33.163369 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 110/225] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:32 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:34.178671 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4e7bbed5-873e-49fd-a641-475d7c03cd1f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:34.179689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4e7bbed5-873e-49fd-a641-475d7c03cd1f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:34.187303 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4e7bbed5-873e-49fd-a641-475d7c03cd1f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:34.187581 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4e7bbed5-873e-49fd-a641-475d7c03cd1f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:34.188316 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4e7bbed5-873e-49fd-a641-475d7c03cd1f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:34.188761 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4e7bbed5-873e-49fd-a641-475d7c03cd1f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:34.191819 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:35:34.357574 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4e7bbed5-873e-49fd-a641-475d7c03cd1f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:34.365633 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-4e7bbed5-873e-49fd-a641-475d7c03cd1f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.193466 Jun 30 16:35:34.366523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 116/226] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:34 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:35.384897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-978d169a-5a1f-4202-ba59-1258dd2210d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:35.386126 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-978d169a-5a1f-4202-ba59-1258dd2210d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:35.393221 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-978d169a-5a1f-4202-ba59-1258dd2210d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:35.393686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-978d169a-5a1f-4202-ba59-1258dd2210d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:35.394513 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-978d169a-5a1f-4202-ba59-1258dd2210d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:35.394966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-978d169a-5a1f-4202-ba59-1258dd2210d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:35.397831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=94 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:35:35.536757 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-978d169a-5a1f-4202-ba59-1258dd2210d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:35.546192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-978d169a-5a1f-4202-ba59-1258dd2210d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.165020 Jun 30 16:35:35.546515 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 111/227] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:35 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:36.564824 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5e00335e-c176-4a0d-bf1b-867f5d7a976f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:36.565549 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5e00335e-c176-4a0d-bf1b-867f5d7a976f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:36.571720 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5e00335e-c176-4a0d-bf1b-867f5d7a976f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:36.572358 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5e00335e-c176-4a0d-bf1b-867f5d7a976f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:36.573158 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5e00335e-c176-4a0d-bf1b-867f5d7a976f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:36.574193 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5e00335e-c176-4a0d-bf1b-867f5d7a976f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:36.710620 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5e00335e-c176-4a0d-bf1b-867f5d7a976f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:36.719419 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5e00335e-c176-4a0d-bf1b-867f5d7a976f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.159150 Jun 30 16:35:36.720397 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 117/228] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:36 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:37.738356 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-134cc89d-ae58-4cdc-8a29-a25921e8fd87 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:37.738879 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-134cc89d-ae58-4cdc-8a29-a25921e8fd87 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:37.747114 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-134cc89d-ae58-4cdc-8a29-a25921e8fd87 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:37.747599 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-134cc89d-ae58-4cdc-8a29-a25921e8fd87 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:37.748383 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-134cc89d-ae58-4cdc-8a29-a25921e8fd87 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:37.748826 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-134cc89d-ae58-4cdc-8a29-a25921e8fd87 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:37.885826 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-134cc89d-ae58-4cdc-8a29-a25921e8fd87 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:37.894842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-134cc89d-ae58-4cdc-8a29-a25921e8fd87 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.160373 Jun 30 16:35:37.895444 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 112/229] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:37 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:38.913169 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0ccb1f0b-42a2-4c0e-8c87-65c3fc4d8479 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:38.913777 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0ccb1f0b-42a2-4c0e-8c87-65c3fc4d8479 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:38.920932 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0ccb1f0b-42a2-4c0e-8c87-65c3fc4d8479 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:38.930194 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0ccb1f0b-42a2-4c0e-8c87-65c3fc4d8479 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:38.930194 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0ccb1f0b-42a2-4c0e-8c87-65c3fc4d8479 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:38.930194 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0ccb1f0b-42a2-4c0e-8c87-65c3fc4d8479 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:39.064761 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0ccb1f0b-42a2-4c0e-8c87-65c3fc4d8479 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:39.070418 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0ccb1f0b-42a2-4c0e-8c87-65c3fc4d8479 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.161065 Jun 30 16:35:39.070776 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 118/230] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:38 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:35:40.089259 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-54b3df4b-defb-4f78-be9c-e82e66b842e0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:40.090682 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-54b3df4b-defb-4f78-be9c-e82e66b842e0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:40.097613 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-54b3df4b-defb-4f78-be9c-e82e66b842e0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:40.098089 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-54b3df4b-defb-4f78-be9c-e82e66b842e0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:40.098868 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-54b3df4b-defb-4f78-be9c-e82e66b842e0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:40.099303 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-54b3df4b-defb-4f78-be9c-e82e66b842e0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:40.255388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-54b3df4b-defb-4f78-be9c-e82e66b842e0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:40.263405 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-54b3df4b-defb-4f78-be9c-e82e66b842e0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.178545 Jun 30 16:35:40.264000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 113/231] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:40 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:40.692681 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-12dc133d-7450-49e7-892d-61beb3819b49 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:40.693261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-12dc133d-7450-49e7-892d-61beb3819b49 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:40.702399 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12dc133d-7450-49e7-892d-61beb3819b49 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:40.702877 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12dc133d-7450-49e7-892d-61beb3819b49 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:40.703699 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12dc133d-7450-49e7-892d-61beb3819b49 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:40.704139 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12dc133d-7450-49e7-892d-61beb3819b49 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:40.734319 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-12dc133d-7450-49e7-892d-61beb3819b49 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/ips" status: 200 len: 149 microversion: 2.1 time: 0.046802 Jun 30 16:35:40.734897 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 119/232] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 30 16:35:40 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/ips => generated 149 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:35:41.286631 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1a2e8b88-2ac3-45a5-b0ed-bdad518554e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:41.287356 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1a2e8b88-2ac3-45a5-b0ed-bdad518554e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:41.295139 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1a2e8b88-2ac3-45a5-b0ed-bdad518554e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:41.295541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1a2e8b88-2ac3-45a5-b0ed-bdad518554e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:41.296329 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1a2e8b88-2ac3-45a5-b0ed-bdad518554e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:41.296776 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1a2e8b88-2ac3-45a5-b0ed-bdad518554e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:41.438061 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1a2e8b88-2ac3-45a5-b0ed-bdad518554e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:41.446280 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1a2e8b88-2ac3-45a5-b0ed-bdad518554e5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.163832 Jun 30 16:35:41.446857 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 114/233] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:41 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:42.464645 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f90c311d-bd91-4639-acd9-7eca0db4f0c5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:42.465779 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f90c311d-bd91-4639-acd9-7eca0db4f0c5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:42.471738 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f90c311d-bd91-4639-acd9-7eca0db4f0c5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:42.472186 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f90c311d-bd91-4639-acd9-7eca0db4f0c5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:42.472957 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f90c311d-bd91-4639-acd9-7eca0db4f0c5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:42.473387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f90c311d-bd91-4639-acd9-7eca0db4f0c5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:42.628278 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f90c311d-bd91-4639-acd9-7eca0db4f0c5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:42.636756 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f90c311d-bd91-4639-acd9-7eca0db4f0c5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.176709 Jun 30 16:35:42.637956 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 120/234] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:42 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:35:42.676675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7ae7d122-4c04-4399-98da-a83735808290 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "154a8320-9554-4bad-8822-7dccf82d319d"}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:35:42.677760 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-7ae7d122-4c04-4399-98da-a83735808290 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:42.685417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7ae7d122-4c04-4399-98da-a83735808290 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:42.685888 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7ae7d122-4c04-4399-98da-a83735808290 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:42.686688 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7ae7d122-4c04-4399-98da-a83735808290 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:42.687129 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7ae7d122-4c04-4399-98da-a83735808290 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:43.655273 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-bc679875-8a7c-4773-99d2-d59bd8b2668e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:43.655993 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-bc679875-8a7c-4773-99d2-d59bd8b2668e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:43.662410 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bc679875-8a7c-4773-99d2-d59bd8b2668e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:43.664149 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bc679875-8a7c-4773-99d2-d59bd8b2668e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:43.664149 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bc679875-8a7c-4773-99d2-d59bd8b2668e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:43.664149 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bc679875-8a7c-4773-99d2-d59bd8b2668e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:43.789530 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7ae7d122-4c04-4399-98da-a83735808290 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "POST /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.116554 Jun 30 16:35:43.790751 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 115/235] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 30 16:35:42 2022] POST /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-volume_attachments => generated 194 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:35:43.820822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-bc679875-8a7c-4773-99d2-d59bd8b2668e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:43.833254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-bc679875-8a7c-4773-99d2-d59bd8b2668e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.182821 Jun 30 16:35:43.834197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 121/236] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:43 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:35:44.857195 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-088d40be-83aa-40a8-899f-27e1445ffd62 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:44.857822 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-088d40be-83aa-40a8-899f-27e1445ffd62 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:44.865172 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-088d40be-83aa-40a8-899f-27e1445ffd62 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:44.865418 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-088d40be-83aa-40a8-899f-27e1445ffd62 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:44.866280 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-088d40be-83aa-40a8-899f-27e1445ffd62 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:44.866728 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-088d40be-83aa-40a8-899f-27e1445ffd62 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:45.062047 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-088d40be-83aa-40a8-899f-27e1445ffd62 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:45.070053 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-088d40be-83aa-40a8-899f-27e1445ffd62 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.218667 Jun 30 16:35:45.071084 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 116/237] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:44 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:46.094724 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6d7eaa10-1987-4cc6-a716-1bc31ae3af4f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:46.095825 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6d7eaa10-1987-4cc6-a716-1bc31ae3af4f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:46.104662 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d7eaa10-1987-4cc6-a716-1bc31ae3af4f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:46.105190 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d7eaa10-1987-4cc6-a716-1bc31ae3af4f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:46.106906 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d7eaa10-1987-4cc6-a716-1bc31ae3af4f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:46.107542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d7eaa10-1987-4cc6-a716-1bc31ae3af4f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:46.252312 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6d7eaa10-1987-4cc6-a716-1bc31ae3af4f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:46.263364 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6d7eaa10-1987-4cc6-a716-1bc31ae3af4f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.173576 Jun 30 16:35:46.264020 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 122/238] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:46 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:47.283884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-02a974a2-f98e-416d-ae27-c4ce2101dd39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:47.285264 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-02a974a2-f98e-416d-ae27-c4ce2101dd39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:47.297707 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-02a974a2-f98e-416d-ae27-c4ce2101dd39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:47.298548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-02a974a2-f98e-416d-ae27-c4ce2101dd39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:47.299985 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-02a974a2-f98e-416d-ae27-c4ce2101dd39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:47.300743 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-02a974a2-f98e-416d-ae27-c4ce2101dd39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:47.452755 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-02a974a2-f98e-416d-ae27-c4ce2101dd39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:47.470990 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-02a974a2-f98e-416d-ae27-c4ce2101dd39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.194526 Jun 30 16:35:47.471884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 117/239] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:47 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:48.488542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d7a69fe9-836a-4eaa-a029-f34ebc7dfcc5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:48.489296 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d7a69fe9-836a-4eaa-a029-f34ebc7dfcc5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:48.491268 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=32 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:35:48.496621 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d7a69fe9-836a-4eaa-a029-f34ebc7dfcc5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:48.497852 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d7a69fe9-836a-4eaa-a029-f34ebc7dfcc5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:48.499100 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d7a69fe9-836a-4eaa-a029-f34ebc7dfcc5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:48.499563 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d7a69fe9-836a-4eaa-a029-f34ebc7dfcc5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:48.649393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d7a69fe9-836a-4eaa-a029-f34ebc7dfcc5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:48.657150 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d7a69fe9-836a-4eaa-a029-f34ebc7dfcc5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.172427 Jun 30 16:35:48.657945 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 123/240] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:48 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:35:49.682996 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d4e2f8fc-52a4-4371-acd3-4f6fc6030e32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:49.684197 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d4e2f8fc-52a4-4371-acd3-4f6fc6030e32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:49.688236 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=28 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:35:49.693605 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d4e2f8fc-52a4-4371-acd3-4f6fc6030e32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:49.694068 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d4e2f8fc-52a4-4371-acd3-4f6fc6030e32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:49.694881 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d4e2f8fc-52a4-4371-acd3-4f6fc6030e32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:49.695374 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d4e2f8fc-52a4-4371-acd3-4f6fc6030e32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:50.040265 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d4e2f8fc-52a4-4371-acd3-4f6fc6030e32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:50.050020 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d4e2f8fc-52a4-4371-acd3-4f6fc6030e32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.371145 Jun 30 16:35:50.050599 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 118/241] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:49 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:35:51.074473 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-b7c5b9be-056e-474c-94ec-dcf2bba1c522 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:51.075084 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-b7c5b9be-056e-474c-94ec-dcf2bba1c522 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:51.081316 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b7c5b9be-056e-474c-94ec-dcf2bba1c522 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:51.081760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b7c5b9be-056e-474c-94ec-dcf2bba1c522 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:51.082519 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b7c5b9be-056e-474c-94ec-dcf2bba1c522 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:51.082953 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b7c5b9be-056e-474c-94ec-dcf2bba1c522 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:51.252578 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b7c5b9be-056e-474c-94ec-dcf2bba1c522 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:51.262092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-b7c5b9be-056e-474c-94ec-dcf2bba1c522 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.191140 Jun 30 16:35:51.262744 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 124/242] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:51 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:35:52.283801 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2fa54a25-3ec5-489a-9f43-c1c68c94b0ce tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:52.283801 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2fa54a25-3ec5-489a-9f43-c1c68c94b0ce tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:52.291387 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2fa54a25-3ec5-489a-9f43-c1c68c94b0ce tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:52.291891 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2fa54a25-3ec5-489a-9f43-c1c68c94b0ce tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:52.292669 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2fa54a25-3ec5-489a-9f43-c1c68c94b0ce tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:52.293114 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2fa54a25-3ec5-489a-9f43-c1c68c94b0ce tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:52.455990 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2fa54a25-3ec5-489a-9f43-c1c68c94b0ce tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:52.469680 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2fa54a25-3ec5-489a-9f43-c1c68c94b0ce tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.193459 Jun 30 16:35:52.470740 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 119/243] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:52 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:35:52.654325 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3fbef27d-2f4c-4ff1-a904-cf7cbed1bf21 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Action: 'create', calling method: .version_select at 0x7f3820354280>, body: {"keypair": {"name": "tempest-keypair-1732624792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKt8uautFTyT0yA29YjsEfp8y/Q9tAko2pOyP1OpUlNXOx1uGGX4SPLlafTd49NUI5W6pKnM5qHYwoZSqgHZssfk2DRQaQKA09mnKMnpdsm412rKQj1IssUoFD7ybIu+sg=="}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:35:52.655549 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-3fbef27d-2f4c-4ff1-a904-cf7cbed1bf21 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'key_pairs'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:35:52.659659 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-3fbef27d-2f4c-4ff1-a904-cf7cbed1bf21 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for user 0a26028451b345968fe86774f44736dd and project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'key_pairs'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:35:52.813115 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3fbef27d-2f4c-4ff1-a904-cf7cbed1bf21 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177509 Jun 30 16:35:52.813790 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 125/244] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 30 16:35:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:35:53.489827 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-68043ca6-a354-4ad0-8a9f-ec3b16212306 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:53.490664 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-68043ca6-a354-4ad0-8a9f-ec3b16212306 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:53.501933 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-68043ca6-a354-4ad0-8a9f-ec3b16212306 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:53.502615 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-68043ca6-a354-4ad0-8a9f-ec3b16212306 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:53.503394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-68043ca6-a354-4ad0-8a9f-ec3b16212306 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:53.503973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-68043ca6-a354-4ad0-8a9f-ec3b16212306 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:53.662803 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-68043ca6-a354-4ad0-8a9f-ec3b16212306 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:53.676778 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-68043ca6-a354-4ad0-8a9f-ec3b16212306 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1500 microversion: 2.1 time: 0.190859 Jun 30 16:35:53.677823 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 120/245] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:53 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1500 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:53.695773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7d1842a3-0231-4b1d-b62b-240e4f210d39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b1b8597-fa6b-4f95-a875-8978156a5fad"}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:35:53.696837 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7d1842a3-0231-4b1d-b62b-240e4f210d39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:53.704042 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7d1842a3-0231-4b1d-b62b-240e4f210d39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:53.704491 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7d1842a3-0231-4b1d-b62b-240e4f210d39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:53.705270 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7d1842a3-0231-4b1d-b62b-240e4f210d39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:53.705714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7d1842a3-0231-4b1d-b62b-240e4f210d39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:53.730436 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-7d1842a3-0231-4b1d-b62b-240e4f210d39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] HTTP exception thrown: Cannot 'attach_volume' instance 6ce60666-aa28-4c5d-b893-faa7f10a777b while it is in vm_state rescued Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7d1842a3-0231-4b1d-b62b-240e4f210d39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Request method failure captured: Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: POST /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b/os-volume_attachments HTTP/1.1 Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 74 Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdBwM9qvHtOnFqUQDtbBU25dM8LsDJJTw1pxd--fjd3blMXEcKPhQWZ-a27FdgjxBMK6dTUcUQH6ay8X0VGGzhyFlL71iFHTgsLgL0YYMg5CBUCtAhR-PSa6BNDD22qbdj4XsHc-GH7-1ZaAlg1BvKwRS17UakMMM4b-BX-kEr6NtA0 Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 839a189179c543c6a704a968170ec022 Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:35:53.732822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:35:53.734294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/839a189179c543c6a704a968170ec022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/839a189179c543c6a704a968170ec022"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_839a189179c543c6a704a968170ec022"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/839a189179c543c6a704a968170ec022"}]}] Jun 30 16:35:53.734294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:35:53.734294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 839a189179c543c6a704a968170ec022 Jun 30 16:35:53.734294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:35:53.734294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-ServerRescueNegativeTestJSON-1419143453-project Jun 30 16:35:53.734294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:35:53.734294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:35:53.734294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 2de23770f4374decb95ff94f3e7f793b Jun 30 16:35:53.734294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1419143453-project Jun 30 16:35:53.734294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Jun 30 16:35:53.734294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {"volumeAttachment": {"volumeId": "7b1b8597-fa6b-4f95-a875-8978156a5fad"}} Jun 30 16:35:53.734294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Cannot 'attach_volume' instance 6ce60666-aa28-4c5d-b893-faa7f10a777b while it is in vm_state rescued Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'server_id': '6ce60666-aa28-4c5d-b893-faa7f10a777b', 'body': {'volumeAttachment': {'volumeId': '7b1b8597-fa6b-4f95-a875-8978156a5fad'}}} Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6ce60666-aa28-4c5d-b893-faa7f10a777b in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:35:53.735177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 6ce60666-aa28-4c5d-b893-faa7f10a777b while it is in vm_state rescued Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:35:53.736586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:35:53.737828 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:35:53.737828 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:35:53.737828 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 6ce60666-aa28-4c5d-b893-faa7f10a777b while it is in vm_state rescued Jun 30 16:35:53.737828 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:35:53.737828 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7d1842a3-0231-4b1d-b62b-240e4f210d39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Returning 409 to user: Cannot 'attach_volume' instance 6ce60666-aa28-4c5d-b893-faa7f10a777b while it is in vm_state rescued {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:35:53.737828 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7d1842a3-0231-4b1d-b62b-240e4f210d39 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "POST /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042854 Jun 30 16:35:53.737828 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 126/246] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 30 16:35:53 2022] POST /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 16:35:53.743668 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-cdecf0f3-d891-4e76-b629-b7133786e1df tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:35:53.744197 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-cdecf0f3-d891-4e76-b629-b7133786e1df tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:53.758410 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cdecf0f3-d891-4e76-b629-b7133786e1df tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:53.759848 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cdecf0f3-d891-4e76-b629-b7133786e1df tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:53.759848 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cdecf0f3-d891-4e76-b629-b7133786e1df tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:53.760349 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cdecf0f3-d891-4e76-b629-b7133786e1df tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:54.142166 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-cdecf0f3-d891-4e76-b629-b7133786e1df tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "POST /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b/action" status: 202 len: 0 microversion: 2.1 time: 0.401234 Jun 30 16:35:54.143723 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 121/247] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 30 16:35:53 2022] POST /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:35:54.164617 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5f68d185-4396-4be0-9b31-5875ce412668 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:54.175919 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5f68d185-4396-4be0-9b31-5875ce412668 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:54.182415 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5f68d185-4396-4be0-9b31-5875ce412668 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:54.183063 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5f68d185-4396-4be0-9b31-5875ce412668 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:54.183959 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5f68d185-4396-4be0-9b31-5875ce412668 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:54.184394 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5f68d185-4396-4be0-9b31-5875ce412668 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:54.342158 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5f68d185-4396-4be0-9b31-5875ce412668 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:54.351306 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5f68d185-4396-4be0-9b31-5875ce412668 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1508 microversion: 2.1 time: 0.202921 Jun 30 16:35:54.352513 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 127/248] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:54 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:55.374493 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-378ce142-45d4-4ded-8146-4886b1a416f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:55.375924 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-378ce142-45d4-4ded-8146-4886b1a416f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:55.383037 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-378ce142-45d4-4ded-8146-4886b1a416f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:55.383755 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-378ce142-45d4-4ded-8146-4886b1a416f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:55.385225 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-378ce142-45d4-4ded-8146-4886b1a416f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:55.385770 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-378ce142-45d4-4ded-8146-4886b1a416f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:55.645980 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-378ce142-45d4-4ded-8146-4886b1a416f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:55.656671 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-378ce142-45d4-4ded-8146-4886b1a416f0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1508 microversion: 2.1 time: 0.288180 Jun 30 16:35:55.658731 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 122/249] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:55 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:56.636642 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-17370870", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16892394-e408-48ab-985b-412d1c45e5c5"}], "security_groups": [{"name": "tempest-securitygroup--2049198012"}], "key_name": "tempest-keypair-1732624792", "user_data": "}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:35:56.676469 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-78d709d5-30da-454c-b028-446e7ee35f22 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:56.677390 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-78d709d5-30da-454c-b028-446e7ee35f22 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:56.684837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78d709d5-30da-454c-b028-446e7ee35f22 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:56.685559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78d709d5-30da-454c-b028-446e7ee35f22 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:56.686726 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78d709d5-30da-454c-b028-446e7ee35f22 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:56.687195 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78d709d5-30da-454c-b028-446e7ee35f22 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:56.796542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.network.neutron [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] validate_networks() for [('16892394-e408-48ab-985b-412d1c45e5c5', None, None, None, None, None)] {{(pid=124814) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:35:56.929146 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-78d709d5-30da-454c-b028-446e7ee35f22 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:56.937179 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-78d709d5-30da-454c-b028-446e7ee35f22 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1508 microversion: 2.1 time: 0.265357 Jun 30 16:35:56.937751 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 123/250] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:56 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1508 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:35:57.259433 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Flavor limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:35:57.259877 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Image limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:35:57.260343 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Flavor pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:35:57.260780 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Image pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:35:57.261185 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:35:57.271441 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:57.271975 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:57.272780 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:57.273208 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:57.292075 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:35:57.296145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for user 0a26028451b345968fe86774f44736dd and project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:35:57.307851 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Going to run 1 instances... {{(pid=124814) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:35:57.310179 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:35:57.526844 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5fcb5126-f591-4381-b236-8f86abc890be tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.894304 Jun 30 16:35:57.529045 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 128/251] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:35:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 16:35:57.539125 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d08442fd-c6ba-4ccb-b7af-40f97fe7b265 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:57.539762 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d08442fd-c6ba-4ccb-b7af-40f97fe7b265 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:57.607340 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d08442fd-c6ba-4ccb-b7af-40f97fe7b265 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:57.617353 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d08442fd-c6ba-4ccb-b7af-40f97fe7b265 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1240 microversion: 2.1 time: 0.082376 Jun 30 16:35:57.617971 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 124/252] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:57 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:57.954734 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f45af8c2-eafb-4c28-b124-357545ddaf2e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:57.955347 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f45af8c2-eafb-4c28-b124-357545ddaf2e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:57.963578 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f45af8c2-eafb-4c28-b124-357545ddaf2e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:57.964385 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f45af8c2-eafb-4c28-b124-357545ddaf2e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:57.965900 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f45af8c2-eafb-4c28-b124-357545ddaf2e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:57.966647 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f45af8c2-eafb-4c28-b124-357545ddaf2e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:58.106358 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f45af8c2-eafb-4c28-b124-357545ddaf2e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:58.114861 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f45af8c2-eafb-4c28-b124-357545ddaf2e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1508 microversion: 2.1 time: 0.164334 Jun 30 16:35:58.118789 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 129/253] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:57 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:58.636539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6123bd3d-9af0-4b33-b459-8db6bb2af9d2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:58.637385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6123bd3d-9af0-4b33-b459-8db6bb2af9d2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:58.703003 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6123bd3d-9af0-4b33-b459-8db6bb2af9d2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:58.710981 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6123bd3d-9af0-4b33-b459-8db6bb2af9d2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1240 microversion: 2.1 time: 0.079462 Jun 30 16:35:58.729094 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 125/254] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:58 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:58.802679 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-197409878", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "networks": [{"uuid": "cb2d6663-d883-4174-ba6e-c7fc0350bd02"}]}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:35:58.858235 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.network.neutron [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] validate_networks() for [('cb2d6663-d883-4174-ba6e-c7fc0350bd02', None, None, None, None, None)] {{(pid=124814) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:35:59.137238 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1b88c494-7158-46ac-81ce-5b64539c3c94 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:59.138765 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1b88c494-7158-46ac-81ce-5b64539c3c94 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:59.148307 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1b88c494-7158-46ac-81ce-5b64539c3c94 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:59.148821 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1b88c494-7158-46ac-81ce-5b64539c3c94 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:59.149585 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1b88c494-7158-46ac-81ce-5b64539c3c94 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:59.150030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1b88c494-7158-46ac-81ce-5b64539c3c94 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:59.331102 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Flavor limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:35:59.331102 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Image limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:35:59.331102 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Flavor pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:35:59.331847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Image pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:35:59.331847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:35:59.362862 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:59.363106 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:59.363950 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:59.364391 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:59.391681 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Getting quotas for project 4df4c3aa7c8044dcbd46064e0e495a84. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:35:59.396132 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Getting quotas for user 96d7af5479ce46b99e333d91128b826e and project 4df4c3aa7c8044dcbd46064e0e495a84. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:35:59.408845 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Going to run 1 instances... {{(pid=124814) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:35:59.411364 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:35:59.418191 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1b88c494-7158-46ac-81ce-5b64539c3c94 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:59.426769 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1b88c494-7158-46ac-81ce-5b64539c3c94 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1508 microversion: 2.1 time: 0.297267 Jun 30 16:35:59.427361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 126/255] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:59 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1508 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:59.555735 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-07ceb750-dbb7-4562-a159-a32feda29cbc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757641 Jun 30 16:35:59.556879 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 130/256] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:35:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 16:35:59.570201 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e16a7326-3190-4003-86e7-e04bf2c65e3b tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:59.580876 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e16a7326-3190-4003-86e7-e04bf2c65e3b tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:59.660229 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e16a7326-3190-4003-86e7-e04bf2c65e3b tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:59.681600 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e16a7326-3190-4003-86e7-e04bf2c65e3b tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1218 microversion: 2.1 time: 0.117014 Jun 30 16:35:59.683599 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 127/257] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:59 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:35:59.745147 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9b26ec30-3d33-4625-be52-1dc801250991 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:35:59.746221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9b26ec30-3d33-4625-be52-1dc801250991 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:35:59.753832 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9b26ec30-3d33-4625-be52-1dc801250991 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:59.754410 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9b26ec30-3d33-4625-be52-1dc801250991 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:59.755279 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9b26ec30-3d33-4625-be52-1dc801250991 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:35:59.755825 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9b26ec30-3d33-4625-be52-1dc801250991 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:35:59.841288 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9b26ec30-3d33-4625-be52-1dc801250991 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:35:59.858962 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9b26ec30-3d33-4625-be52-1dc801250991 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1244 microversion: 2.1 time: 0.117258 Jun 30 16:35:59.860257 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 131/258] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:35:59 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1244 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:00.454224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-daa06917-4fd5-4db2-a88c-97ef5b274c3c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:00.454837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-daa06917-4fd5-4db2-a88c-97ef5b274c3c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:00.462538 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-daa06917-4fd5-4db2-a88c-97ef5b274c3c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:00.463128 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-daa06917-4fd5-4db2-a88c-97ef5b274c3c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:00.464009 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-daa06917-4fd5-4db2-a88c-97ef5b274c3c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:00.464412 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-daa06917-4fd5-4db2-a88c-97ef5b274c3c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:00.494331 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:00.644615 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-daa06917-4fd5-4db2-a88c-97ef5b274c3c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:00.655521 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-daa06917-4fd5-4db2-a88c-97ef5b274c3c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1514 microversion: 2.1 time: 0.206587 Jun 30 16:36:00.657815 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 128/259] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:00 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:00.716805 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-eea8ddc3-f9ef-4611-a703-1094eacb2f66 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:00.717965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-eea8ddc3-f9ef-4611-a703-1094eacb2f66 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:00.809662 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-eea8ddc3-f9ef-4611-a703-1094eacb2f66 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:00.821220 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-eea8ddc3-f9ef-4611-a703-1094eacb2f66 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1218 microversion: 2.1 time: 0.111805 Jun 30 16:36:00.822000 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 132/260] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:00 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:00.877001 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d3102b40-42dc-4a31-b395-c2778fc4ffff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:00.877945 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d3102b40-42dc-4a31-b395-c2778fc4ffff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:00.887308 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d3102b40-42dc-4a31-b395-c2778fc4ffff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:00.888050 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d3102b40-42dc-4a31-b395-c2778fc4ffff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:00.892051 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d3102b40-42dc-4a31-b395-c2778fc4ffff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:00.892051 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d3102b40-42dc-4a31-b395-c2778fc4ffff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:00.973523 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d3102b40-42dc-4a31-b395-c2778fc4ffff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:00.982383 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d3102b40-42dc-4a31-b395-c2778fc4ffff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1236 microversion: 2.1 time: 0.109370 Jun 30 16:36:00.984071 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 129/261] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:00 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1236 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:01.844175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7ad5059d-0e71-435c-b711-40203a54aeba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:01.845276 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7ad5059d-0e71-435c-b711-40203a54aeba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:01.860684 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7ad5059d-0e71-435c-b711-40203a54aeba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:01.862042 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7ad5059d-0e71-435c-b711-40203a54aeba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:01.863910 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7ad5059d-0e71-435c-b711-40203a54aeba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:01.865019 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7ad5059d-0e71-435c-b711-40203a54aeba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:01.954733 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7ad5059d-0e71-435c-b711-40203a54aeba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:01.963451 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7ad5059d-0e71-435c-b711-40203a54aeba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1222 microversion: 2.1 time: 0.125275 Jun 30 16:36:01.964084 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 133/262] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:01 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:02.022546 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b012e8d9-fdbe-4fa2-80a2-bef5a102dcf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:02.022546 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b012e8d9-fdbe-4fa2-80a2-bef5a102dcf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:02.029966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b012e8d9-fdbe-4fa2-80a2-bef5a102dcf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:02.031014 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b012e8d9-fdbe-4fa2-80a2-bef5a102dcf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:02.031776 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b012e8d9-fdbe-4fa2-80a2-bef5a102dcf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:02.032988 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b012e8d9-fdbe-4fa2-80a2-bef5a102dcf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:02.124850 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b012e8d9-fdbe-4fa2-80a2-bef5a102dcf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:02.136747 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b012e8d9-fdbe-4fa2-80a2-bef5a102dcf8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1292 microversion: 2.1 time: 0.129585 Jun 30 16:36:02.137449 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 130/263] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:02 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1292 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:02.990344 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-26a1a83e-1abd-49da-9aa4-1bd640997cf3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:02.991130 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-26a1a83e-1abd-49da-9aa4-1bd640997cf3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:02.999228 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-26a1a83e-1abd-49da-9aa4-1bd640997cf3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:03.000534 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-26a1a83e-1abd-49da-9aa4-1bd640997cf3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:03.000846 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-26a1a83e-1abd-49da-9aa4-1bd640997cf3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:03.001347 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-26a1a83e-1abd-49da-9aa4-1bd640997cf3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:03.078060 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-26a1a83e-1abd-49da-9aa4-1bd640997cf3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:03.090313 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-26a1a83e-1abd-49da-9aa4-1bd640997cf3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1222 microversion: 2.1 time: 0.105451 Jun 30 16:36:03.109603 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 134/264] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:02 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1222 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:03.175626 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-708130b5-7bd0-4cb1-9e3a-c6c758f4c863 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:03.176745 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-708130b5-7bd0-4cb1-9e3a-c6c758f4c863 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:03.189267 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-708130b5-7bd0-4cb1-9e3a-c6c758f4c863 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:03.190071 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-708130b5-7bd0-4cb1-9e3a-c6c758f4c863 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:03.191018 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-708130b5-7bd0-4cb1-9e3a-c6c758f4c863 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:03.191748 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-708130b5-7bd0-4cb1-9e3a-c6c758f4c863 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:03.283204 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-708130b5-7bd0-4cb1-9e3a-c6c758f4c863 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:03.294724 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-708130b5-7bd0-4cb1-9e3a-c6c758f4c863 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1292 microversion: 2.1 time: 0.126779 Jun 30 16:36:03.295551 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 131/265] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:03 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1292 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:04.123681 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-76c8f15f-1a2b-4df2-82a9-89bc6d8e80b9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:04.126283 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-76c8f15f-1a2b-4df2-82a9-89bc6d8e80b9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:04.141836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-76c8f15f-1a2b-4df2-82a9-89bc6d8e80b9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:04.142638 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-76c8f15f-1a2b-4df2-82a9-89bc6d8e80b9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:04.144247 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-76c8f15f-1a2b-4df2-82a9-89bc6d8e80b9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:04.144998 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-76c8f15f-1a2b-4df2-82a9-89bc6d8e80b9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:04.230915 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-76c8f15f-1a2b-4df2-82a9-89bc6d8e80b9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:04.246409 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-76c8f15f-1a2b-4df2-82a9-89bc6d8e80b9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1214 microversion: 2.1 time: 0.130393 Jun 30 16:36:04.246759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 135/266] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:04 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1214 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:04.319374 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4d244b01-1df1-4144-8408-2be0f97d3a20 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:04.320758 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4d244b01-1df1-4144-8408-2be0f97d3a20 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:04.332230 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4d244b01-1df1-4144-8408-2be0f97d3a20 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:04.332726 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4d244b01-1df1-4144-8408-2be0f97d3a20 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:04.334117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4d244b01-1df1-4144-8408-2be0f97d3a20 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:04.334925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4d244b01-1df1-4144-8408-2be0f97d3a20 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:04.418282 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-4d244b01-1df1-4144-8408-2be0f97d3a20 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:04.427998 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-4d244b01-1df1-4144-8408-2be0f97d3a20 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1300 microversion: 2.1 time: 0.117081 Jun 30 16:36:04.428580 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 132/267] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:04 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:05.265601 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-328b89d5-7aae-46da-aa74-1a8ef5785bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:05.266622 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-328b89d5-7aae-46da-aa74-1a8ef5785bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:05.273303 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-328b89d5-7aae-46da-aa74-1a8ef5785bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:05.273753 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-328b89d5-7aae-46da-aa74-1a8ef5785bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:05.274541 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-328b89d5-7aae-46da-aa74-1a8ef5785bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:05.274984 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-328b89d5-7aae-46da-aa74-1a8ef5785bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:05.348304 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-328b89d5-7aae-46da-aa74-1a8ef5785bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:05.350948 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=100 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:05.358174 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-328b89d5-7aae-46da-aa74-1a8ef5785bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1214 microversion: 2.1 time: 0.097417 Jun 30 16:36:05.359397 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 136/268] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:05 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1214 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:05.450180 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d56a707e-8245-4d2e-a279-96691a7a2848 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:05.451274 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d56a707e-8245-4d2e-a279-96691a7a2848 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:05.465634 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d56a707e-8245-4d2e-a279-96691a7a2848 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:05.466276 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d56a707e-8245-4d2e-a279-96691a7a2848 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:05.467438 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d56a707e-8245-4d2e-a279-96691a7a2848 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:05.468638 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d56a707e-8245-4d2e-a279-96691a7a2848 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:05.549465 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d56a707e-8245-4d2e-a279-96691a7a2848 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:05.557825 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d56a707e-8245-4d2e-a279-96691a7a2848 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1300 microversion: 2.1 time: 0.114332 Jun 30 16:36:05.558420 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 133/269] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:05 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:06.378028 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-91ffe73b-76fa-4b07-a629-8aca6ad066f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:06.378645 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-91ffe73b-76fa-4b07-a629-8aca6ad066f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:06.385266 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-91ffe73b-76fa-4b07-a629-8aca6ad066f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:06.385717 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-91ffe73b-76fa-4b07-a629-8aca6ad066f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:06.386523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-91ffe73b-76fa-4b07-a629-8aca6ad066f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:06.386989 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-91ffe73b-76fa-4b07-a629-8aca6ad066f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:06.478279 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-91ffe73b-76fa-4b07-a629-8aca6ad066f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:06.489711 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-91ffe73b-76fa-4b07-a629-8aca6ad066f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1270 microversion: 2.1 time: 0.116663 Jun 30 16:36:06.490858 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 137/270] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:06 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1270 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:06.574532 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-dd284921-6e19-450c-942b-23ec1aa2028d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:06.576055 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-dd284921-6e19-450c-942b-23ec1aa2028d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:06.584930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dd284921-6e19-450c-942b-23ec1aa2028d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:06.585387 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dd284921-6e19-450c-942b-23ec1aa2028d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:06.586203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dd284921-6e19-450c-942b-23ec1aa2028d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:06.586760 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dd284921-6e19-450c-942b-23ec1aa2028d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:06.661110 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-dd284921-6e19-450c-942b-23ec1aa2028d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:06.676092 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-dd284921-6e19-450c-942b-23ec1aa2028d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1298 microversion: 2.1 time: 0.105320 Jun 30 16:36:06.677178 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 134/271] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:06 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:06.845136 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-fdca33f4-1a36-4a27-98e0-5709aada5fb2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Action: 'create', calling method: .version_select at 0x7f3820394e50>, body: {"keypair": {"name": "tempest-keypair-1349269840", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTHlVvtaTVMxR/dY6Kp2XRDYXMyspbdetmD6du8OLU82aqK6CuPh8qccTwuDcASAzmXvIwYgS16UQPLnUwLzPn+5LPbWgYJSDSqZtgK/ZBENebCAWAsGc2eI2PkIIznEg=="}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:06.860975 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-fdca33f4-1a36-4a27-98e0-5709aada5fb2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Getting quotas for project 839a189179c543c6a704a968170ec022. Resources: {'key_pairs'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:36:06.865061 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-fdca33f4-1a36-4a27-98e0-5709aada5fb2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Getting quotas for user 2de23770f4374decb95ff94f3e7f793b and project 839a189179c543c6a704a968170ec022. Resources: {'key_pairs'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:36:07.061163 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-fdca33f4-1a36-4a27-98e0-5709aada5fb2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.221200 Jun 30 16:36:07.062217 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 138/272] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 30 16:36:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:36:07.519804 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d281b79d-a326-4d2b-9425-99b9010fd8ba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:07.520330 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d281b79d-a326-4d2b-9425-99b9010fd8ba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:07.528802 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d281b79d-a326-4d2b-9425-99b9010fd8ba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:07.529520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d281b79d-a326-4d2b-9425-99b9010fd8ba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:07.530580 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d281b79d-a326-4d2b-9425-99b9010fd8ba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:07.531033 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d281b79d-a326-4d2b-9425-99b9010fd8ba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:07.578621 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a8bc3b87-ee3b-4e99-bf28-f7c90e0c1b92 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:07.580327 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a8bc3b87-ee3b-4e99-bf28-f7c90e0c1b92 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:07.587335 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a8bc3b87-ee3b-4e99-bf28-f7c90e0c1b92 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:07.588077 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a8bc3b87-ee3b-4e99-bf28-f7c90e0c1b92 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:07.589033 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a8bc3b87-ee3b-4e99-bf28-f7c90e0c1b92 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:07.589631 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a8bc3b87-ee3b-4e99-bf28-f7c90e0c1b92 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:07.619952 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a8bc3b87-ee3b-4e99-bf28-f7c90e0c1b92 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/ips" status: 200 len: 144 microversion: 2.1 time: 0.045163 Jun 30 16:36:07.625746 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 139/273] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 30 16:36:07 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/ips => generated 144 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:36:07.656814 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d281b79d-a326-4d2b-9425-99b9010fd8ba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:07.690534 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d281b79d-a326-4d2b-9425-99b9010fd8ba tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1288 microversion: 2.1 time: 0.175679 Jun 30 16:36:07.694227 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 135/274] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:07 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1288 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:07.719369 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-95b0cef7-4a9c-450d-a5f8-9e9441e80a8a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:07.721707 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-95b0cef7-4a9c-450d-a5f8-9e9441e80a8a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:07.738171 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-95b0cef7-4a9c-450d-a5f8-9e9441e80a8a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:07.738879 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-95b0cef7-4a9c-450d-a5f8-9e9441e80a8a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:07.739954 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-95b0cef7-4a9c-450d-a5f8-9e9441e80a8a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:07.741050 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-95b0cef7-4a9c-450d-a5f8-9e9441e80a8a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:08.030245 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-95b0cef7-4a9c-450d-a5f8-9e9441e80a8a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:08.046918 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-95b0cef7-4a9c-450d-a5f8-9e9441e80a8a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1366 microversion: 2.1 time: 0.346499 Jun 30 16:36:08.049099 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 140/275] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:07 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:08.164471 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-43e67a2e-6a8e-426a-9714-23c6a4c473d4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:08.165288 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-43e67a2e-6a8e-426a-9714-23c6a4c473d4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:08.174657 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-43e67a2e-6a8e-426a-9714-23c6a4c473d4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:08.175010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-43e67a2e-6a8e-426a-9714-23c6a4c473d4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:08.175854 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-43e67a2e-6a8e-426a-9714-23c6a4c473d4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:08.176326 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-43e67a2e-6a8e-426a-9714-23c6a4c473d4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:08.203600 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-43e67a2e-6a8e-426a-9714-23c6a4c473d4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/ips" status: 200 len: 151 microversion: 2.20 time: 0.044087 Jun 30 16:36:08.204523 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 136/276] 10.222.0.67 () {60 vars in 1288 bytes} [Thu Jun 30 16:36:08 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 30 16:36:08.747605 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-81a5b2d3-f377-410d-adcd-20fb7330f5cb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:08.750012 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-81a5b2d3-f377-410d-adcd-20fb7330f5cb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:08.774623 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-81a5b2d3-f377-410d-adcd-20fb7330f5cb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:08.775352 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-81a5b2d3-f377-410d-adcd-20fb7330f5cb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:08.789130 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-81a5b2d3-f377-410d-adcd-20fb7330f5cb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:08.789673 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-81a5b2d3-f377-410d-adcd-20fb7330f5cb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:08.925568 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-81a5b2d3-f377-410d-adcd-20fb7330f5cb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:08.940028 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-81a5b2d3-f377-410d-adcd-20fb7330f5cb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1276 microversion: 2.1 time: 0.217848 Jun 30 16:36:08.941354 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 141/277] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:08 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1276 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:09.094156 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-69996ecf-65e8-4f4e-be59-612b5f36ac31 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:09.096231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-69996ecf-65e8-4f4e-be59-612b5f36ac31 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:09.137250 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-a6b316ea-7b26-4fc7-8265-919f6e5655de req-200e2a6c-dee2-4d51-8e42-bb4581d925cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de05418a-11bf-401c-b0cb-52968e5d6d07", "tag": "5d6aee83-8fca-4ec9-8a36-9eed297963c5"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:09.143840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-69996ecf-65e8-4f4e-be59-612b5f36ac31 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:09.144383 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-69996ecf-65e8-4f4e-be59-612b5f36ac31 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:09.148817 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-69996ecf-65e8-4f4e-be59-612b5f36ac31 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:09.149530 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-69996ecf-65e8-4f4e-be59-612b5f36ac31 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:09.175828 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-a6b316ea-7b26-4fc7-8265-919f6e5655de req-200e2a6c-dee2-4d51-8e42-bb4581d925cb service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:09.176825 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-a6b316ea-7b26-4fc7-8265-919f6e5655de req-200e2a6c-dee2-4d51-8e42-bb4581d925cb service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:09.206530 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-a6b316ea-7b26-4fc7-8265-919f6e5655de req-200e2a6c-dee2-4d51-8e42-bb4581d925cb service nova] Creating event network-changed:5d6aee83-8fca-4ec9-8a36-9eed297963c5 for instance de05418a-11bf-401c-b0cb-52968e5d6d07 on hv-cinder-83602 Jun 30 16:36:09.224664 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-a6b316ea-7b26-4fc7-8265-919f6e5655de req-200e2a6c-dee2-4d51-8e42-bb4581d925cb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096726 Jun 30 16:36:09.228940 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 142/278] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:36:09.517820 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-69996ecf-65e8-4f4e-be59-612b5f36ac31 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:09.528025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-69996ecf-65e8-4f4e-be59-612b5f36ac31 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1366 microversion: 2.1 time: 0.462074 Jun 30 16:36:09.528944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 137/279] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:09 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1366 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:09.987615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ada20db0-733a-4014-af28-b81e25aedba9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:09.996303 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ada20db0-733a-4014-af28-b81e25aedba9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:10.029159 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=4 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:10.050001 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ada20db0-733a-4014-af28-b81e25aedba9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:10.051170 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ada20db0-733a-4014-af28-b81e25aedba9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:10.053821 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ada20db0-733a-4014-af28-b81e25aedba9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:10.057914 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ada20db0-733a-4014-af28-b81e25aedba9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:10.371507 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ada20db0-733a-4014-af28-b81e25aedba9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:10.383054 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ada20db0-733a-4014-af28-b81e25aedba9 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1318 microversion: 2.1 time: 0.424266 Jun 30 16:36:10.394044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 143/280] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:09 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:10.556456 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b3663a79-3a53-4d2c-aa38-64343e001c1e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:10.566295 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b3663a79-3a53-4d2c-aa38-64343e001c1e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:10.566295 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=6 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:10.570243 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b3663a79-3a53-4d2c-aa38-64343e001c1e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:10.571143 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b3663a79-3a53-4d2c-aa38-64343e001c1e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:10.572478 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b3663a79-3a53-4d2c-aa38-64343e001c1e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:10.574104 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b3663a79-3a53-4d2c-aa38-64343e001c1e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:10.847621 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b3663a79-3a53-4d2c-aa38-64343e001c1e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:10.861897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b3663a79-3a53-4d2c-aa38-64343e001c1e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1366 microversion: 2.1 time: 0.316016 Jun 30 16:36:10.863172 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 138/281] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:10 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:11.303759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-ac6106f3-5d20-487c-b8bb-8a202ab0bba8 req-16679469-7361-4204-b9ff-a9faf1e722ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc03842b-e56f-4828-99c9-0b175cd2277f", "tag": "3f33f308-ce97-4120-965f-b9d4d472b4a5"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:11.312815 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-ac6106f3-5d20-487c-b8bb-8a202ab0bba8 req-16679469-7361-4204-b9ff-a9faf1e722ee service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:11.313535 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-ac6106f3-5d20-487c-b8bb-8a202ab0bba8 req-16679469-7361-4204-b9ff-a9faf1e722ee service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:11.325298 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-ac6106f3-5d20-487c-b8bb-8a202ab0bba8 req-16679469-7361-4204-b9ff-a9faf1e722ee service nova] Creating event network-changed:3f33f308-ce97-4120-965f-b9d4d472b4a5 for instance cc03842b-e56f-4828-99c9-0b175cd2277f on hv-cinder-83602 Jun 30 16:36:11.331735 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-ac6106f3-5d20-487c-b8bb-8a202ab0bba8 req-16679469-7361-4204-b9ff-a9faf1e722ee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031662 Jun 30 16:36:11.332563 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 144/282] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:36:11.407646 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-fd4281d3-0281-43d1-8b4b-93fbd50ec5c7 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:11.409056 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-fd4281d3-0281-43d1-8b4b-93fbd50ec5c7 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:11.416722 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fd4281d3-0281-43d1-8b4b-93fbd50ec5c7 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:11.418795 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fd4281d3-0281-43d1-8b4b-93fbd50ec5c7 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:11.418795 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fd4281d3-0281-43d1-8b4b-93fbd50ec5c7 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:11.418795 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fd4281d3-0281-43d1-8b4b-93fbd50ec5c7 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:11.478120 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0776f9f8-1ef9-4592-ae66-ed292bedf987 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7f413e5-4c09-452c-a8ed-a6886542ca3f"}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:11.479266 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0776f9f8-1ef9-4592-ae66-ed292bedf987 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:11.485966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0776f9f8-1ef9-4592-ae66-ed292bedf987 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:11.486958 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0776f9f8-1ef9-4592-ae66-ed292bedf987 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:11.487865 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0776f9f8-1ef9-4592-ae66-ed292bedf987 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:11.488308 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0776f9f8-1ef9-4592-ae66-ed292bedf987 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:11.665050 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-fd4281d3-0281-43d1-8b4b-93fbd50ec5c7 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:11.673169 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-fd4281d3-0281-43d1-8b4b-93fbd50ec5c7 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1318 microversion: 2.1 time: 0.271621 Jun 30 16:36:11.674302 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 139/283] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:11 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:11.680291 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1ec4a550-ebbb-4921-8271-32367395f390 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:11.682452 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1ec4a550-ebbb-4921-8271-32367395f390 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:11.697558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1ec4a550-ebbb-4921-8271-32367395f390 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:11.698286 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1ec4a550-ebbb-4921-8271-32367395f390 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:11.699909 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1ec4a550-ebbb-4921-8271-32367395f390 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:11.700513 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1ec4a550-ebbb-4921-8271-32367395f390 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:11.745820 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-1ec4a550-ebbb-4921-8271-32367395f390 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lazy-loading 'flavor' on Instance uuid ab1f1412-017f-448b-a6bb-21d09d668a46 {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:36:12.564236 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1ec4a550-ebbb-4921-8271-32367395f390 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "POST /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/action" status: 202 len: 0 microversion: 2.20 time: 0.888233 Jun 30 16:36:12.565187 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 140/284] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Jun 30 16:36:11 2022] POST /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/action => generated 0 bytes in 890 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:36:12.571157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-3fbea877-24c8-4f1c-af78-f56fe099d60a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:12.572115 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-3fbea877-24c8-4f1c-af78-f56fe099d60a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:12.592396 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3fbea877-24c8-4f1c-af78-f56fe099d60a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:12.592865 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3fbea877-24c8-4f1c-af78-f56fe099d60a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:12.593658 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3fbea877-24c8-4f1c-af78-f56fe099d60a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:12.594294 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3fbea877-24c8-4f1c-af78-f56fe099d60a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:12.774672 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-3fbea877-24c8-4f1c-af78-f56fe099d60a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:12.805892 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-3fbea877-24c8-4f1c-af78-f56fe099d60a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1366 microversion: 2.1 time: 0.239434 Jun 30 16:36:12.806842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 141/285] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:12 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:12.812217 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-702090201", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aff5e7b4-b06a-4065-b396-531d28bbc09e"}], "security_groups": [{"name": "tempest-securitygroup--1879615648"}], "key_name": "tempest-keypair-1349269840", "user_data": "}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:12.968564 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.network.neutron [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] validate_networks() for [('aff5e7b4-b06a-4065-b396-531d28bbc09e', None, None, None, None, None)] {{(pid=124815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:36:13.280450 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0776f9f8-1ef9-4592-ae66-ed292bedf987 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "POST /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.806373 Jun 30 16:36:13.287284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 145/286] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 30 16:36:11 2022] POST /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/os-volume_attachments => generated 194 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:36:13.305632 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-20850ca9-82e4-4dcd-9c26-1575ca3f3a31 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:13.306420 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-20850ca9-82e4-4dcd-9c26-1575ca3f3a31 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:13.317442 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-20850ca9-82e4-4dcd-9c26-1575ca3f3a31 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:13.317924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-20850ca9-82e4-4dcd-9c26-1575ca3f3a31 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:13.319600 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-20850ca9-82e4-4dcd-9c26-1575ca3f3a31 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:13.320224 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-20850ca9-82e4-4dcd-9c26-1575ca3f3a31 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:13.656830 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-20850ca9-82e4-4dcd-9c26-1575ca3f3a31 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:13.666300 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-20850ca9-82e4-4dcd-9c26-1575ca3f3a31 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:13.667881 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-20850ca9-82e4-4dcd-9c26-1575ca3f3a31 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:13.669067 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-20850ca9-82e4-4dcd-9c26-1575ca3f3a31 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1723 microversion: 2.20 time: 0.386221 Jun 30 16:36:13.669664 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 146/287] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:13 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1723 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:13.676324 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8505d42e-dd8e-4ac6-a969-51651ca80273 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:13.677301 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8505d42e-dd8e-4ac6-a969-51651ca80273 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:13.679464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:13.684552 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8505d42e-dd8e-4ac6-a969-51651ca80273 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:13.685216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8505d42e-dd8e-4ac6-a969-51651ca80273 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:13.686056 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8505d42e-dd8e-4ac6-a969-51651ca80273 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:13.686554 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8505d42e-dd8e-4ac6-a969-51651ca80273 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:14.137040 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Flavor limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:36:14.138663 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Image limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:36:14.139597 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Flavor pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:36:14.140267 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Image pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:36:14.141232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:36:14.143501 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8505d42e-dd8e-4ac6-a969-51651ca80273 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:14.153398 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:14.154428 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:14.155516 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:14.156156 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:14.158537 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8505d42e-dd8e-4ac6-a969-51651ca80273 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1318 microversion: 2.1 time: 0.486795 Jun 30 16:36:14.169344 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 147/288] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:13 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:14.175210 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-562b9368-e60d-4b3e-92bd-cc6e52a10981 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:14.175667 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-562b9368-e60d-4b3e-92bd-cc6e52a10981 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:14.184673 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Getting quotas for project 839a189179c543c6a704a968170ec022. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:36:14.196883 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-562b9368-e60d-4b3e-92bd-cc6e52a10981 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:14.196883 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-562b9368-e60d-4b3e-92bd-cc6e52a10981 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:14.196883 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-562b9368-e60d-4b3e-92bd-cc6e52a10981 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:14.196883 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-562b9368-e60d-4b3e-92bd-cc6e52a10981 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:14.202831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Getting quotas for user 2de23770f4374decb95ff94f3e7f793b and project 839a189179c543c6a704a968170ec022. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:36:14.219543 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Going to run 1 instances... {{(pid=124815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:36:14.222979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:36:14.384790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c47c1ac8-ed53-47e9-a253-6205cf6f5cc6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.573673 Jun 30 16:36:14.386532 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 142/289] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:36:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 16:36:14.398872 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-bfa6ceb4-dab5-496f-af4e-7b46c61c0942 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:14.400331 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-bfa6ceb4-dab5-496f-af4e-7b46c61c0942 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:14.475391 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-562b9368-e60d-4b3e-92bd-cc6e52a10981 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:14.506620 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-562b9368-e60d-4b3e-92bd-cc6e52a10981 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1366 microversion: 2.1 time: 0.333417 Jun 30 16:36:14.510752 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 148/290] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:14 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:14.558103 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-bfa6ceb4-dab5-496f-af4e-7b46c61c0942 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:14.572673 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-bfa6ceb4-dab5-496f-af4e-7b46c61c0942 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1245 microversion: 2.1 time: 0.178332 Jun 30 16:36:14.590942 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 143/291] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:14 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1245 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:14.692327 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6e6c1d58-8a16-4aac-a697-7e254cfb2992 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:14.693287 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6e6c1d58-8a16-4aac-a697-7e254cfb2992 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:14.706445 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6e6c1d58-8a16-4aac-a697-7e254cfb2992 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:14.707290 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6e6c1d58-8a16-4aac-a697-7e254cfb2992 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:14.708393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6e6c1d58-8a16-4aac-a697-7e254cfb2992 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:14.709252 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6e6c1d58-8a16-4aac-a697-7e254cfb2992 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:14.898646 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6e6c1d58-8a16-4aac-a697-7e254cfb2992 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:14.908051 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6e6c1d58-8a16-4aac-a697-7e254cfb2992 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:14.911582 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6e6c1d58-8a16-4aac-a697-7e254cfb2992 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:14.913197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6e6c1d58-8a16-4aac-a697-7e254cfb2992 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1723 microversion: 2.20 time: 0.227868 Jun 30 16:36:14.914225 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 149/292] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:14 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:15.177766 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-bb8b987d-e067-4afe-af05-17dd8dcac251 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:15.181494 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-bb8b987d-e067-4afe-af05-17dd8dcac251 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:15.199557 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bb8b987d-e067-4afe-af05-17dd8dcac251 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:15.200837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bb8b987d-e067-4afe-af05-17dd8dcac251 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:15.202610 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bb8b987d-e067-4afe-af05-17dd8dcac251 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:15.203482 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bb8b987d-e067-4afe-af05-17dd8dcac251 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:15.382588 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-bb8b987d-e067-4afe-af05-17dd8dcac251 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:15.397930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-bb8b987d-e067-4afe-af05-17dd8dcac251 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1318 microversion: 2.1 time: 0.225632 Jun 30 16:36:15.398722 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 144/293] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:15 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:15.543416 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-edb36dc4-6b47-4d75-b17e-204438da8759 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:15.544074 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-edb36dc4-6b47-4d75-b17e-204438da8759 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:15.565187 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-edb36dc4-6b47-4d75-b17e-204438da8759 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:15.568483 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-edb36dc4-6b47-4d75-b17e-204438da8759 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:15.569351 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-edb36dc4-6b47-4d75-b17e-204438da8759 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:15.569942 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-edb36dc4-6b47-4d75-b17e-204438da8759 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:15.598305 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-70774022-8a4e-41a0-a5d4-6e325b810e74 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:15.599300 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-70774022-8a4e-41a0-a5d4-6e325b810e74 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:15.609688 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-70774022-8a4e-41a0-a5d4-6e325b810e74 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:15.611545 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-70774022-8a4e-41a0-a5d4-6e325b810e74 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:15.613440 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-70774022-8a4e-41a0-a5d4-6e325b810e74 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:15.613888 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-70774022-8a4e-41a0-a5d4-6e325b810e74 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:15.622392 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:15.754700 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-70774022-8a4e-41a0-a5d4-6e325b810e74 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:15.764404 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-70774022-8a4e-41a0-a5d4-6e325b810e74 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1249 microversion: 2.1 time: 0.170924 Jun 30 16:36:15.766629 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 145/294] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:15 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1249 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:15.932611 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b07607c7-7f65-4bd0-a41a-1acc7506ad5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:15.933263 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b07607c7-7f65-4bd0-a41a-1acc7506ad5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:15.940158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b07607c7-7f65-4bd0-a41a-1acc7506ad5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:15.940935 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b07607c7-7f65-4bd0-a41a-1acc7506ad5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:15.941895 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b07607c7-7f65-4bd0-a41a-1acc7506ad5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:15.942511 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b07607c7-7f65-4bd0-a41a-1acc7506ad5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:15.997767 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-edb36dc4-6b47-4d75-b17e-204438da8759 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:16.009322 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-edb36dc4-6b47-4d75-b17e-204438da8759 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1366 microversion: 2.1 time: 0.471159 Jun 30 16:36:16.020394 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 150/295] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:15 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:16.244856 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b07607c7-7f65-4bd0-a41a-1acc7506ad5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:16.282266 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b07607c7-7f65-4bd0-a41a-1acc7506ad5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:16.285087 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b07607c7-7f65-4bd0-a41a-1acc7506ad5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:16.287835 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b07607c7-7f65-4bd0-a41a-1acc7506ad5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1723 microversion: 2.20 time: 0.359101 Jun 30 16:36:16.289955 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 146/296] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:15 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1723 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:36:16.416092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-47270b17-dfbe-4a2b-bae7-ee81c2c956b6 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:16.416727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-47270b17-dfbe-4a2b-bae7-ee81c2c956b6 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:16.423302 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-47270b17-dfbe-4a2b-bae7-ee81c2c956b6 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:16.423856 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-47270b17-dfbe-4a2b-bae7-ee81c2c956b6 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:16.425443 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-47270b17-dfbe-4a2b-bae7-ee81c2c956b6 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:16.425881 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-47270b17-dfbe-4a2b-bae7-ee81c2c956b6 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:16.734934 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-47270b17-dfbe-4a2b-bae7-ee81c2c956b6 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:16.754506 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-47270b17-dfbe-4a2b-bae7-ee81c2c956b6 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1318 microversion: 2.1 time: 0.343004 Jun 30 16:36:16.757449 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 151/297] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:16 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:16.788416 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6b92e27b-5cae-4bac-ab9d-9aaa3bf8ab24 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:16.788416 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6b92e27b-5cae-4bac-ab9d-9aaa3bf8ab24 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:16.794239 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6b92e27b-5cae-4bac-ab9d-9aaa3bf8ab24 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:16.794728 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6b92e27b-5cae-4bac-ab9d-9aaa3bf8ab24 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:16.795548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6b92e27b-5cae-4bac-ab9d-9aaa3bf8ab24 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:16.796189 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6b92e27b-5cae-4bac-ab9d-9aaa3bf8ab24 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:16.947610 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6b92e27b-5cae-4bac-ab9d-9aaa3bf8ab24 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:16.966653 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6b92e27b-5cae-4bac-ab9d-9aaa3bf8ab24 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1297 microversion: 2.1 time: 0.184497 Jun 30 16:36:16.981721 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 147/298] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:16 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1297 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:17.024712 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=22 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:17.033747 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-558f97b2-5fc1-4cca-bbeb-4be97671095d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:17.034358 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-558f97b2-5fc1-4cca-bbeb-4be97671095d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:17.045531 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-558f97b2-5fc1-4cca-bbeb-4be97671095d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:17.046274 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-558f97b2-5fc1-4cca-bbeb-4be97671095d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:17.047108 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-558f97b2-5fc1-4cca-bbeb-4be97671095d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:17.047575 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-558f97b2-5fc1-4cca-bbeb-4be97671095d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:17.206281 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-558f97b2-5fc1-4cca-bbeb-4be97671095d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:17.215006 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-558f97b2-5fc1-4cca-bbeb-4be97671095d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1366 microversion: 2.1 time: 0.191134 Jun 30 16:36:17.237869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 152/299] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:17 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:17.312422 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a62fa337-6eba-41c0-ae67-1ae34c6663cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:17.312422 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a62fa337-6eba-41c0-ae67-1ae34c6663cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:17.373954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a62fa337-6eba-41c0-ae67-1ae34c6663cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:17.376286 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a62fa337-6eba-41c0-ae67-1ae34c6663cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:17.378459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a62fa337-6eba-41c0-ae67-1ae34c6663cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:17.380733 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a62fa337-6eba-41c0-ae67-1ae34c6663cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:17.730818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-a402efe8-935b-4c62-9297-8c05100515f7 req-31cc9619-c82a-4bc5-8905-295afb1ba87e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de05418a-11bf-401c-b0cb-52968e5d6d07", "name": "network-vif-plugged", "status": "completed", "tag": "5d6aee83-8fca-4ec9-8a36-9eed297963c5"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:17.744343 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-a402efe8-935b-4c62-9297-8c05100515f7 req-31cc9619-c82a-4bc5-8905-295afb1ba87e service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:17.748929 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-a402efe8-935b-4c62-9297-8c05100515f7 req-31cc9619-c82a-4bc5-8905-295afb1ba87e service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:17.759109 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a62fa337-6eba-41c0-ae67-1ae34c6663cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:17.776742 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a62fa337-6eba-41c0-ae67-1ae34c6663cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:17.785630 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a62fa337-6eba-41c0-ae67-1ae34c6663cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:17.792050 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a62fa337-6eba-41c0-ae67-1ae34c6663cb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1723 microversion: 2.20 time: 0.486662 Jun 30 16:36:17.793202 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 148/300] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:17 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1723 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:17.827324 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a1a8295f-f363-41ce-8ae6-a5555b6ffd8b tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:17.832486 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a1a8295f-f363-41ce-8ae6-a5555b6ffd8b tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:17.834766 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-a402efe8-935b-4c62-9297-8c05100515f7 req-31cc9619-c82a-4bc5-8905-295afb1ba87e service nova] Creating event network-vif-plugged:5d6aee83-8fca-4ec9-8a36-9eed297963c5 for instance de05418a-11bf-401c-b0cb-52968e5d6d07 on hv-cinder-83602 Jun 30 16:36:17.847956 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a1a8295f-f363-41ce-8ae6-a5555b6ffd8b tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:17.849431 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-a402efe8-935b-4c62-9297-8c05100515f7 req-31cc9619-c82a-4bc5-8905-295afb1ba87e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129482 Jun 30 16:36:17.850608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 153/301] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:36:17.851756 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a1a8295f-f363-41ce-8ae6-a5555b6ffd8b tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:17.852978 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a1a8295f-f363-41ce-8ae6-a5555b6ffd8b tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:17.853647 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a1a8295f-f363-41ce-8ae6-a5555b6ffd8b tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:17.989554 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d92da228-6478-4227-a9a7-95bdc2216600 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:17.990635 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d92da228-6478-4227-a9a7-95bdc2216600 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:18.028424 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d92da228-6478-4227-a9a7-95bdc2216600 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:18.029458 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d92da228-6478-4227-a9a7-95bdc2216600 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:18.030691 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d92da228-6478-4227-a9a7-95bdc2216600 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:18.031341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d92da228-6478-4227-a9a7-95bdc2216600 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:18.160405 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d92da228-6478-4227-a9a7-95bdc2216600 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:18.173454 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d92da228-6478-4227-a9a7-95bdc2216600 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1315 microversion: 2.1 time: 0.190661 Jun 30 16:36:18.181295 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 154/302] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:17 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:18.233550 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-674fa5ee-9a54-49d8-a7cf-3796da707348 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:18.234388 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-674fa5ee-9a54-49d8-a7cf-3796da707348 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:18.241366 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-674fa5ee-9a54-49d8-a7cf-3796da707348 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:18.242153 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-674fa5ee-9a54-49d8-a7cf-3796da707348 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:18.243323 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-674fa5ee-9a54-49d8-a7cf-3796da707348 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:18.243985 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-674fa5ee-9a54-49d8-a7cf-3796da707348 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:18.263983 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:18.296554 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a1a8295f-f363-41ce-8ae6-a5555b6ffd8b tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:18.306140 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a1a8295f-f363-41ce-8ae6-a5555b6ffd8b tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1318 microversion: 2.1 time: 0.507303 Jun 30 16:36:18.309084 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 149/303] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:17 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:18.673934 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-674fa5ee-9a54-49d8-a7cf-3796da707348 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:18.686272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-674fa5ee-9a54-49d8-a7cf-3796da707348 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1366 microversion: 2.1 time: 0.456405 Jun 30 16:36:18.689177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 155/304] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:18 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1366 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:18.810971 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e34bb529-b024-45e2-a924-93acfe54d370 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:18.812504 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e34bb529-b024-45e2-a924-93acfe54d370 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:18.827004 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e34bb529-b024-45e2-a924-93acfe54d370 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:18.827745 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e34bb529-b024-45e2-a924-93acfe54d370 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:18.829565 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e34bb529-b024-45e2-a924-93acfe54d370 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:18.830332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e34bb529-b024-45e2-a924-93acfe54d370 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:19.203501 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5c199e38-34b7-4848-9e7f-3949a782ec30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:19.214908 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5c199e38-34b7-4848-9e7f-3949a782ec30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:19.214908 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5c199e38-34b7-4848-9e7f-3949a782ec30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:19.214908 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5c199e38-34b7-4848-9e7f-3949a782ec30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:19.214908 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5c199e38-34b7-4848-9e7f-3949a782ec30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:19.215388 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5c199e38-34b7-4848-9e7f-3949a782ec30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:19.546283 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e34bb529-b024-45e2-a924-93acfe54d370 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:19.559906 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e34bb529-b024-45e2-a924-93acfe54d370 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:19.563437 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e34bb529-b024-45e2-a924-93acfe54d370 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:19.566009 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e34bb529-b024-45e2-a924-93acfe54d370 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1723 microversion: 2.20 time: 0.758933 Jun 30 16:36:19.578149 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 150/305] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:18 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1723 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:19.586423 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d9d485b0-4f2b-462a-980e-c2ca1d5472d4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:19.587373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d9d485b0-4f2b-462a-980e-c2ca1d5472d4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:19.595346 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d9d485b0-4f2b-462a-980e-c2ca1d5472d4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:19.596722 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d9d485b0-4f2b-462a-980e-c2ca1d5472d4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:19.597782 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d9d485b0-4f2b-462a-980e-c2ca1d5472d4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:19.598786 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d9d485b0-4f2b-462a-980e-c2ca1d5472d4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:19.603586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5c199e38-34b7-4848-9e7f-3949a782ec30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:19.617969 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5c199e38-34b7-4848-9e7f-3949a782ec30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1371 microversion: 2.1 time: 0.418822 Jun 30 16:36:19.621912 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 156/306] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:19 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1371 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:19.708820 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-02319cbd-5f04-4854-86cf-a720ae84d395 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:19.710236 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-02319cbd-5f04-4854-86cf-a720ae84d395 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:19.741291 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-02319cbd-5f04-4854-86cf-a720ae84d395 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:19.743405 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-02319cbd-5f04-4854-86cf-a720ae84d395 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:19.745163 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-02319cbd-5f04-4854-86cf-a720ae84d395 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:19.746377 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-02319cbd-5f04-4854-86cf-a720ae84d395 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:20.008055 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d9d485b0-4f2b-462a-980e-c2ca1d5472d4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:20.022446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d9d485b0-4f2b-462a-980e-c2ca1d5472d4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1318 microversion: 2.1 time: 0.441673 Jun 30 16:36:20.023896 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 151/307] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:19 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1318 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:20.038260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-4d004953-cd14-4a83-af8f-7b2a40dfb0a5 req-6a3f7f81-8e98-4999-99ae-11d76e1b2e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc03842b-e56f-4828-99c9-0b175cd2277f", "name": "network-vif-plugged", "status": "completed", "tag": "3f33f308-ce97-4120-965f-b9d4d472b4a5"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:20.056759 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:20.060733 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-4d004953-cd14-4a83-af8f-7b2a40dfb0a5 req-6a3f7f81-8e98-4999-99ae-11d76e1b2e3f service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:20.063374 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-4d004953-cd14-4a83-af8f-7b2a40dfb0a5 req-6a3f7f81-8e98-4999-99ae-11d76e1b2e3f service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:20.093340 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-4d004953-cd14-4a83-af8f-7b2a40dfb0a5 req-6a3f7f81-8e98-4999-99ae-11d76e1b2e3f service nova] Creating event network-vif-plugged:3f33f308-ce97-4120-965f-b9d4d472b4a5 for instance cc03842b-e56f-4828-99c9-0b175cd2277f on hv-cinder-83602 Jun 30 16:36:20.104449 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-4d004953-cd14-4a83-af8f-7b2a40dfb0a5 req-6a3f7f81-8e98-4999-99ae-11d76e1b2e3f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079107 Jun 30 16:36:20.107710 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 152/308] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:36:20.245394 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-02319cbd-5f04-4854-86cf-a720ae84d395 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:20.256449 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-02319cbd-5f04-4854-86cf-a720ae84d395 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1366 microversion: 2.1 time: 0.554265 Jun 30 16:36:20.257099 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 157/309] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:19 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1366 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:20.586854 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-471509b9-9d31-4135-b72f-76cfe15bb3a1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:20.589398 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-471509b9-9d31-4135-b72f-76cfe15bb3a1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:20.599774 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-471509b9-9d31-4135-b72f-76cfe15bb3a1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:20.600654 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-471509b9-9d31-4135-b72f-76cfe15bb3a1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:20.616181 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-471509b9-9d31-4135-b72f-76cfe15bb3a1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:20.617059 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-471509b9-9d31-4135-b72f-76cfe15bb3a1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:20.638976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e47d6f72-04c0-40c7-8c6c-3d47297a620b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:20.639986 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e47d6f72-04c0-40c7-8c6c-3d47297a620b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:20.656685 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e47d6f72-04c0-40c7-8c6c-3d47297a620b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:20.660834 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e47d6f72-04c0-40c7-8c6c-3d47297a620b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:20.665120 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e47d6f72-04c0-40c7-8c6c-3d47297a620b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:20.669209 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e47d6f72-04c0-40c7-8c6c-3d47297a620b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:21.228289 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-e47d6f72-04c0-40c7-8c6c-3d47297a620b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:21.237871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e47d6f72-04c0-40c7-8c6c-3d47297a620b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1371 microversion: 2.1 time: 0.603352 Jun 30 16:36:21.244003 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 158/310] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:20 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1371 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:21.253520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-84a9b2a9-f619-4841-984a-be0fd9f9ed61 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:21.254908 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-84a9b2a9-f619-4841-984a-be0fd9f9ed61 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:21.276025 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-84a9b2a9-f619-4841-984a-be0fd9f9ed61 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:21.276025 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-84a9b2a9-f619-4841-984a-be0fd9f9ed61 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:21.276025 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-84a9b2a9-f619-4841-984a-be0fd9f9ed61 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:21.276025 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-84a9b2a9-f619-4841-984a-be0fd9f9ed61 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:21.276585 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-471509b9-9d31-4135-b72f-76cfe15bb3a1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:21.290907 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-471509b9-9d31-4135-b72f-76cfe15bb3a1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:21.292490 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-471509b9-9d31-4135-b72f-76cfe15bb3a1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:21.300996 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-471509b9-9d31-4135-b72f-76cfe15bb3a1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1723 microversion: 2.20 time: 0.718766 Jun 30 16:36:21.314496 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 153/311] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:20 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1723 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:21.345618 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0aea4f4c-40ec-4630-a471-1f14374e6aec tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:21.347391 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-0aea4f4c-40ec-4630-a471-1f14374e6aec tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:21.370807 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0aea4f4c-40ec-4630-a471-1f14374e6aec tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:21.376163 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0aea4f4c-40ec-4630-a471-1f14374e6aec tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:21.382574 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0aea4f4c-40ec-4630-a471-1f14374e6aec tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:21.383563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0aea4f4c-40ec-4630-a471-1f14374e6aec tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:21.632550 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-84a9b2a9-f619-4841-984a-be0fd9f9ed61 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:21.649548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-84a9b2a9-f619-4841-984a-be0fd9f9ed61 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1318 microversion: 2.1 time: 0.401223 Jun 30 16:36:21.649548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 159/312] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:21 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:21.667282 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-b4500148-5e0c-4058-a671-a826ad8dd2e8 req-b0fb0bde-6cbd-41b4-a25a-f429577b95bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d786bea4-1a92-4eaf-8450-f69f05986687", "tag": "237f85c7-d517-4bd7-9b4c-cfb1b755a321"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:21.682792 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-b4500148-5e0c-4058-a671-a826ad8dd2e8 req-b0fb0bde-6cbd-41b4-a25a-f429577b95bc service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:21.688380 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-b4500148-5e0c-4058-a671-a826ad8dd2e8 req-b0fb0bde-6cbd-41b4-a25a-f429577b95bc service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:21.712973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-b4500148-5e0c-4058-a671-a826ad8dd2e8 req-b0fb0bde-6cbd-41b4-a25a-f429577b95bc service nova] Creating event network-changed:237f85c7-d517-4bd7-9b4c-cfb1b755a321 for instance d786bea4-1a92-4eaf-8450-f69f05986687 on hv-cinder-83602 Jun 30 16:36:21.729551 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-b4500148-5e0c-4058-a671-a826ad8dd2e8 req-b0fb0bde-6cbd-41b4-a25a-f429577b95bc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077793 Jun 30 16:36:21.730632 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 160/313] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:36:21.775415 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-0aea4f4c-40ec-4630-a471-1f14374e6aec tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:21.795151 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-0aea4f4c-40ec-4630-a471-1f14374e6aec tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1556 microversion: 2.1 time: 0.477079 Jun 30 16:36:21.798371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 154/314] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:21 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1556 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:21.822636 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c6cada7d-c774-4a55-a269-900c1ad6c0ba tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:21.823517 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c6cada7d-c774-4a55-a269-900c1ad6c0ba tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:21.830958 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c6cada7d-c774-4a55-a269-900c1ad6c0ba tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:21.832316 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c6cada7d-c774-4a55-a269-900c1ad6c0ba tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:21.833323 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c6cada7d-c774-4a55-a269-900c1ad6c0ba tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:21.833939 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c6cada7d-c774-4a55-a269-900c1ad6c0ba tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:21.931032 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c6cada7d-c774-4a55-a269-900c1ad6c0ba tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113065 Jun 30 16:36:21.932159 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 161/315] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 30 16:36:21 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:36:22.274840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-522510ac-03bb-4901-ba7b-659f548ac0e6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:22.275834 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-522510ac-03bb-4901-ba7b-659f548ac0e6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:22.282881 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-522510ac-03bb-4901-ba7b-659f548ac0e6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:22.283599 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-522510ac-03bb-4901-ba7b-659f548ac0e6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:22.284861 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-522510ac-03bb-4901-ba7b-659f548ac0e6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:22.285380 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-522510ac-03bb-4901-ba7b-659f548ac0e6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:22.324557 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-50f9be2e-37ec-4fc0-9635-b6650974adef tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:22.331429 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-50f9be2e-37ec-4fc0-9635-b6650974adef tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:22.381303 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-50f9be2e-37ec-4fc0-9635-b6650974adef tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:22.388876 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-50f9be2e-37ec-4fc0-9635-b6650974adef tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:22.391780 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-50f9be2e-37ec-4fc0-9635-b6650974adef tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:22.392238 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-50f9be2e-37ec-4fc0-9635-b6650974adef tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:22.723867 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-522510ac-03bb-4901-ba7b-659f548ac0e6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:22.734975 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-522510ac-03bb-4901-ba7b-659f548ac0e6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1371 microversion: 2.1 time: 0.471491 Jun 30 16:36:22.736101 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 155/316] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:22 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1371 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:22.754413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-affb606e-b524-4406-b8ff-1f3ee2bfa63a tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:22.769895 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-affb606e-b524-4406-b8ff-1f3ee2bfa63a tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:22.776610 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-affb606e-b524-4406-b8ff-1f3ee2bfa63a tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:22.901832 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-affb606e-b524-4406-b8ff-1f3ee2bfa63a tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Going to try to stop instance {{(pid=124815) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 16:36:22.905233 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-50f9be2e-37ec-4fc0-9635-b6650974adef tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:22.918476 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-50f9be2e-37ec-4fc0-9635-b6650974adef tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:22.924586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-50f9be2e-37ec-4fc0-9635-b6650974adef tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:22.926216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-50f9be2e-37ec-4fc0-9635-b6650974adef tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1723 microversion: 2.20 time: 0.610415 Jun 30 16:36:22.929751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 162/317] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:22 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1723 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:36:22.937450 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-011e2759-92c2-47ee-8da6-3fd121b827f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:22.940482 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-011e2759-92c2-47ee-8da6-3fd121b827f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:22.958394 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-011e2759-92c2-47ee-8da6-3fd121b827f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:22.958850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-011e2759-92c2-47ee-8da6-3fd121b827f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:22.963192 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-011e2759-92c2-47ee-8da6-3fd121b827f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:22.963192 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-011e2759-92c2-47ee-8da6-3fd121b827f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:23.234572 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-011e2759-92c2-47ee-8da6-3fd121b827f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:23.244449 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-011e2759-92c2-47ee-8da6-3fd121b827f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1318 microversion: 2.1 time: 0.313098 Jun 30 16:36:23.245464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 163/318] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:22 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:23.285359 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-affb606e-b524-4406-b8ff-1f3ee2bfa63a tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "POST /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/action" status: 202 len: 0 microversion: 2.1 time: 0.546724 Jun 30 16:36:23.292449 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 156/319] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 30 16:36:22 2022] POST /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/action => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:36:23.320680 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-49fe43be-3d98-4b00-875c-0cbd6d59d2dc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:23.322387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-49fe43be-3d98-4b00-875c-0cbd6d59d2dc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:23.336272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-49fe43be-3d98-4b00-875c-0cbd6d59d2dc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:23.343523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-49fe43be-3d98-4b00-875c-0cbd6d59d2dc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:23.344823 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-49fe43be-3d98-4b00-875c-0cbd6d59d2dc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:23.345970 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-49fe43be-3d98-4b00-875c-0cbd6d59d2dc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:23.651504 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-49fe43be-3d98-4b00-875c-0cbd6d59d2dc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:23.670590 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-49fe43be-3d98-4b00-875c-0cbd6d59d2dc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1722 microversion: 2.1 time: 0.376935 Jun 30 16:36:23.671185 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 164/320] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:23 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1722 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:23.768953 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1b5a0b9f-c061-43a9-a98f-3fcd0afe3bd0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:23.770335 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1b5a0b9f-c061-43a9-a98f-3fcd0afe3bd0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:23.848232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1b5a0b9f-c061-43a9-a98f-3fcd0afe3bd0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:23.850615 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1b5a0b9f-c061-43a9-a98f-3fcd0afe3bd0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:23.854071 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1b5a0b9f-c061-43a9-a98f-3fcd0afe3bd0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:23.854701 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1b5a0b9f-c061-43a9-a98f-3fcd0afe3bd0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:23.957312 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0029dcbf-9a73-4a9b-9344-5304818fa286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:23.958441 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0029dcbf-9a73-4a9b-9344-5304818fa286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:23.983922 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0029dcbf-9a73-4a9b-9344-5304818fa286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:23.985157 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0029dcbf-9a73-4a9b-9344-5304818fa286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:23.986468 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0029dcbf-9a73-4a9b-9344-5304818fa286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:23.988347 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0029dcbf-9a73-4a9b-9344-5304818fa286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:24.168339 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:24.182212 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1b5a0b9f-c061-43a9-a98f-3fcd0afe3bd0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:24.190241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1b5a0b9f-c061-43a9-a98f-3fcd0afe3bd0 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1371 microversion: 2.1 time: 0.439390 Jun 30 16:36:24.192040 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 157/321] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:23 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1371 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:24.197608 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-520661ab-cb14-4f84-948b-5d6dd7fb5c76 req-f41bebe7-d109-455c-91d1-7d8fa7908707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de05418a-11bf-401c-b0cb-52968e5d6d07", "tag": "5d6aee83-8fca-4ec9-8a36-9eed297963c5"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:24.207788 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-520661ab-cb14-4f84-948b-5d6dd7fb5c76 req-f41bebe7-d109-455c-91d1-7d8fa7908707 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:24.208725 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-520661ab-cb14-4f84-948b-5d6dd7fb5c76 req-f41bebe7-d109-455c-91d1-7d8fa7908707 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:24.222685 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-520661ab-cb14-4f84-948b-5d6dd7fb5c76 req-f41bebe7-d109-455c-91d1-7d8fa7908707 service nova] Creating event network-changed:5d6aee83-8fca-4ec9-8a36-9eed297963c5 for instance de05418a-11bf-401c-b0cb-52968e5d6d07 on hv-cinder-83602 Jun 30 16:36:24.228982 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-520661ab-cb14-4f84-948b-5d6dd7fb5c76 req-f41bebe7-d109-455c-91d1-7d8fa7908707 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035372 Jun 30 16:36:24.230051 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 158/322] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:36:24.303238 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f409046b-90e1-4126-959d-ba98cd91a323 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:24.308160 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f409046b-90e1-4126-959d-ba98cd91a323 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:24.316842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f409046b-90e1-4126-959d-ba98cd91a323 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:24.317324 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f409046b-90e1-4126-959d-ba98cd91a323 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:24.318325 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f409046b-90e1-4126-959d-ba98cd91a323 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:24.318838 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f409046b-90e1-4126-959d-ba98cd91a323 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:24.355766 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0029dcbf-9a73-4a9b-9344-5304818fa286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:24.365646 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0029dcbf-9a73-4a9b-9344-5304818fa286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:24.374661 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0029dcbf-9a73-4a9b-9344-5304818fa286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:24.376118 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0029dcbf-9a73-4a9b-9344-5304818fa286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1723 microversion: 2.20 time: 0.433055 Jun 30 16:36:24.376839 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 165/323] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:23 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1723 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:36:24.522070 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f409046b-90e1-4126-959d-ba98cd91a323 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:24.530887 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f409046b-90e1-4126-959d-ba98cd91a323 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1507 microversion: 2.1 time: 0.239717 Jun 30 16:36:24.531808 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 159/324] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:24 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:24.688490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-cbc9f45c-3a91-42d4-852a-ed5bdd1bd95b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:24.689282 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-cbc9f45c-3a91-42d4-852a-ed5bdd1bd95b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:24.701483 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cbc9f45c-3a91-42d4-852a-ed5bdd1bd95b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:24.711673 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cbc9f45c-3a91-42d4-852a-ed5bdd1bd95b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:24.712698 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cbc9f45c-3a91-42d4-852a-ed5bdd1bd95b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:24.713156 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cbc9f45c-3a91-42d4-852a-ed5bdd1bd95b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:24.935655 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-cbc9f45c-3a91-42d4-852a-ed5bdd1bd95b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:24.968042 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-cbc9f45c-3a91-42d4-852a-ed5bdd1bd95b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1722 microversion: 2.1 time: 0.275280 Jun 30 16:36:24.968042 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 166/325] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:24 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:25.205824 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=8 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:25.211557 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c3655210-ec48-4aa4-85c1-fa342fb3e683 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:25.212186 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c3655210-ec48-4aa4-85c1-fa342fb3e683 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:25.223958 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3655210-ec48-4aa4-85c1-fa342fb3e683 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:25.224434 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3655210-ec48-4aa4-85c1-fa342fb3e683 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:25.225243 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3655210-ec48-4aa4-85c1-fa342fb3e683 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:25.225684 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3655210-ec48-4aa4-85c1-fa342fb3e683 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:25.411309 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d66f27b9-648e-417d-bdac-6bd1943c124b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:25.412102 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d66f27b9-648e-417d-bdac-6bd1943c124b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:25.422579 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d66f27b9-648e-417d-bdac-6bd1943c124b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:25.423249 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d66f27b9-648e-417d-bdac-6bd1943c124b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:25.428260 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d66f27b9-648e-417d-bdac-6bd1943c124b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:25.428260 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d66f27b9-648e-417d-bdac-6bd1943c124b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:25.495919 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c3655210-ec48-4aa4-85c1-fa342fb3e683 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:25.545969 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c3655210-ec48-4aa4-85c1-fa342fb3e683 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1371 microversion: 2.1 time: 0.323684 Jun 30 16:36:25.545969 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 160/326] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:25 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:25.735262 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d66f27b9-648e-417d-bdac-6bd1943c124b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:25.750264 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d66f27b9-648e-417d-bdac-6bd1943c124b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:25.762024 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d66f27b9-648e-417d-bdac-6bd1943c124b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:25.766170 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d66f27b9-648e-417d-bdac-6bd1943c124b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1723 microversion: 2.20 time: 0.358063 Jun 30 16:36:25.784544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 167/327] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:25 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:36:25.996468 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8d906043-7588-4a58-89f5-b7b493590253 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:25.997115 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8d906043-7588-4a58-89f5-b7b493590253 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:26.020240 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8d906043-7588-4a58-89f5-b7b493590253 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:26.020710 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8d906043-7588-4a58-89f5-b7b493590253 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:26.027133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8d906043-7588-4a58-89f5-b7b493590253 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:26.030251 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8d906043-7588-4a58-89f5-b7b493590253 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:26.505562 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8d906043-7588-4a58-89f5-b7b493590253 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:26.521910 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8d906043-7588-4a58-89f5-b7b493590253 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1722 microversion: 2.1 time: 0.541025 Jun 30 16:36:26.522515 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 161/328] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:25 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1722 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:26.556298 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-abdf63f3-087d-4d3e-81df-70a606748ce6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:26.558713 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-abdf63f3-087d-4d3e-81df-70a606748ce6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:26.576275 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-abdf63f3-087d-4d3e-81df-70a606748ce6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:26.579168 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-abdf63f3-087d-4d3e-81df-70a606748ce6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:26.582488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-abdf63f3-087d-4d3e-81df-70a606748ce6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:26.582996 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-abdf63f3-087d-4d3e-81df-70a606748ce6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:26.797660 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8f193a5d-bdf1-47c0-9fa0-e21b31bb78de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:26.798220 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8f193a5d-bdf1-47c0-9fa0-e21b31bb78de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:26.829187 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8f193a5d-bdf1-47c0-9fa0-e21b31bb78de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:26.829187 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8f193a5d-bdf1-47c0-9fa0-e21b31bb78de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:26.829187 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8f193a5d-bdf1-47c0-9fa0-e21b31bb78de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:26.831154 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8f193a5d-bdf1-47c0-9fa0-e21b31bb78de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:26.841897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:27.277341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-abdf63f3-087d-4d3e-81df-70a606748ce6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:27.310894 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-abdf63f3-087d-4d3e-81df-70a606748ce6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1371 microversion: 2.1 time: 0.760908 Jun 30 16:36:27.342974 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 168/329] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:26 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1371 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:27.463949 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8f193a5d-bdf1-47c0-9fa0-e21b31bb78de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:27.474122 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8f193a5d-bdf1-47c0-9fa0-e21b31bb78de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:27.476514 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8f193a5d-bdf1-47c0-9fa0-e21b31bb78de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:27.478275 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8f193a5d-bdf1-47c0-9fa0-e21b31bb78de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1723 microversion: 2.20 time: 0.685088 Jun 30 16:36:27.479116 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 162/330] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:26 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1723 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:36:27.549273 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d82db1dd-2ce7-41dc-8cf7-a871fb7107a9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:27.550872 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d82db1dd-2ce7-41dc-8cf7-a871fb7107a9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:27.572558 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d82db1dd-2ce7-41dc-8cf7-a871fb7107a9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:27.577871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d82db1dd-2ce7-41dc-8cf7-a871fb7107a9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:27.583744 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d82db1dd-2ce7-41dc-8cf7-a871fb7107a9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:27.586964 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d82db1dd-2ce7-41dc-8cf7-a871fb7107a9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:27.885010 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d82db1dd-2ce7-41dc-8cf7-a871fb7107a9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:27.912246 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d82db1dd-2ce7-41dc-8cf7-a871fb7107a9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1722 microversion: 2.1 time: 0.374334 Jun 30 16:36:27.943939 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 169/331] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:27 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1722 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:28.364538 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-15f18f46-23f7-4376-aed3-7c72a66adfe2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:28.366641 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-15f18f46-23f7-4376-aed3-7c72a66adfe2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:28.391021 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-15f18f46-23f7-4376-aed3-7c72a66adfe2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:28.391855 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-15f18f46-23f7-4376-aed3-7c72a66adfe2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:28.397019 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-15f18f46-23f7-4376-aed3-7c72a66adfe2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:28.397019 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-15f18f46-23f7-4376-aed3-7c72a66adfe2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:28.509168 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f5354c2f-5e2d-4d3f-8f07-30b8566c504a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:28.510169 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f5354c2f-5e2d-4d3f-8f07-30b8566c504a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:28.555804 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f5354c2f-5e2d-4d3f-8f07-30b8566c504a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:28.556865 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f5354c2f-5e2d-4d3f-8f07-30b8566c504a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:28.558132 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f5354c2f-5e2d-4d3f-8f07-30b8566c504a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:28.560003 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f5354c2f-5e2d-4d3f-8f07-30b8566c504a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:29.260793 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f5354c2f-5e2d-4d3f-8f07-30b8566c504a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:29.308130 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f5354c2f-5e2d-4d3f-8f07-30b8566c504a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:29.310431 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f5354c2f-5e2d-4d3f-8f07-30b8566c504a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:29.318121 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f5354c2f-5e2d-4d3f-8f07-30b8566c504a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1744 microversion: 2.20 time: 0.811171 Jun 30 16:36:29.319369 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 170/332] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:28 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1744 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:29.325667 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-819cd8f0-b389-4554-aba5-de7582316ed5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:29.331767 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-819cd8f0-b389-4554-aba5-de7582316ed5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:29.339075 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-819cd8f0-b389-4554-aba5-de7582316ed5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:29.339872 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-819cd8f0-b389-4554-aba5-de7582316ed5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:29.340882 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-819cd8f0-b389-4554-aba5-de7582316ed5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:29.341521 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-819cd8f0-b389-4554-aba5-de7582316ed5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:29.342692 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-15f18f46-23f7-4376-aed3-7c72a66adfe2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:29.357473 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-15f18f46-23f7-4376-aed3-7c72a66adfe2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1371 microversion: 2.1 time: 1.000430 Jun 30 16:36:29.373797 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 163/333] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:28 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1371 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:29.630644 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-819cd8f0-b389-4554-aba5-de7582316ed5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:29.639847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-819cd8f0-b389-4554-aba5-de7582316ed5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1722 microversion: 2.1 time: 0.319008 Jun 30 16:36:29.640554 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 171/334] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:29 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1722 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:30.344785 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-20b02e5f-fb49-423e-88b6-766a22e1eaf0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:30.346478 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-20b02e5f-fb49-423e-88b6-766a22e1eaf0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:30.375102 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-20b02e5f-fb49-423e-88b6-766a22e1eaf0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:30.385483 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2546682a-b50e-4a94-9b92-a488f701f90f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:30.386299 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-20b02e5f-fb49-423e-88b6-766a22e1eaf0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:30.386422 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2546682a-b50e-4a94-9b92-a488f701f90f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:30.386534 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-20b02e5f-fb49-423e-88b6-766a22e1eaf0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:30.386534 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-20b02e5f-fb49-423e-88b6-766a22e1eaf0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:30.396537 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2546682a-b50e-4a94-9b92-a488f701f90f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:30.396995 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2546682a-b50e-4a94-9b92-a488f701f90f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:30.399694 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2546682a-b50e-4a94-9b92-a488f701f90f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:30.400140 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2546682a-b50e-4a94-9b92-a488f701f90f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:30.808315 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2546682a-b50e-4a94-9b92-a488f701f90f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:30.818778 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2546682a-b50e-4a94-9b92-a488f701f90f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1371 microversion: 2.1 time: 0.446084 Jun 30 16:36:30.828971 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 172/335] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:30 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1371 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:30.835517 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8c7e8e94-e6cc-461d-aec7-40c42876fbcc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:30.836458 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8c7e8e94-e6cc-461d-aec7-40c42876fbcc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:30.843760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8c7e8e94-e6cc-461d-aec7-40c42876fbcc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:30.844280 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8c7e8e94-e6cc-461d-aec7-40c42876fbcc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:30.845072 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8c7e8e94-e6cc-461d-aec7-40c42876fbcc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:30.845566 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8c7e8e94-e6cc-461d-aec7-40c42876fbcc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:30.847572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-20b02e5f-fb49-423e-88b6-766a22e1eaf0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:30.849601 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=100 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:30.880274 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-20b02e5f-fb49-423e-88b6-766a22e1eaf0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:30.893817 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-20b02e5f-fb49-423e-88b6-766a22e1eaf0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:30.901705 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-20b02e5f-fb49-423e-88b6-766a22e1eaf0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1744 microversion: 2.20 time: 0.567087 Jun 30 16:36:30.913716 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 164/336] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:30 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1744 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:31.237325 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8c7e8e94-e6cc-461d-aec7-40c42876fbcc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:31.250111 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8c7e8e94-e6cc-461d-aec7-40c42876fbcc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1722 microversion: 2.1 time: 0.419778 Jun 30 16:36:31.261073 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 173/337] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:30 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1722 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:31.842595 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0bdf911c-3119-4a9a-9dba-efaec58325c7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:31.845027 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-0bdf911c-3119-4a9a-9dba-efaec58325c7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:31.866750 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0bdf911c-3119-4a9a-9dba-efaec58325c7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:31.871461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0bdf911c-3119-4a9a-9dba-efaec58325c7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:31.877506 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0bdf911c-3119-4a9a-9dba-efaec58325c7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:31.882350 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0bdf911c-3119-4a9a-9dba-efaec58325c7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:31.928892 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f91a0a62-f58c-4769-a067-e64f944d5019 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:31.929696 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f91a0a62-f58c-4769-a067-e64f944d5019 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:31.948663 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f91a0a62-f58c-4769-a067-e64f944d5019 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:31.949206 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f91a0a62-f58c-4769-a067-e64f944d5019 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:31.950344 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f91a0a62-f58c-4769-a067-e64f944d5019 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:31.950957 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f91a0a62-f58c-4769-a067-e64f944d5019 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:32.378803 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-0bdf911c-3119-4a9a-9dba-efaec58325c7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:32.413871 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-0bdf911c-3119-4a9a-9dba-efaec58325c7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1371 microversion: 2.1 time: 0.581006 Jun 30 16:36:32.415334 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 165/338] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:31 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1371 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:32.429014 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-a493dd7d-af5f-4744-ab0d-fb5849c21d91 req-9256244b-b2a1-41d6-b849-5fd23e1212a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d786bea4-1a92-4eaf-8450-f69f05986687", "name": "network-vif-plugged", "status": "completed", "tag": "237f85c7-d517-4bd7-9b4c-cfb1b755a321"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:32.461411 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f91a0a62-f58c-4769-a067-e64f944d5019 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:32.462879 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-a493dd7d-af5f-4744-ab0d-fb5849c21d91 req-9256244b-b2a1-41d6-b849-5fd23e1212a6 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:32.463821 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-a493dd7d-af5f-4744-ab0d-fb5849c21d91 req-9256244b-b2a1-41d6-b849-5fd23e1212a6 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:32.474221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f91a0a62-f58c-4769-a067-e64f944d5019 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:32.491554 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f91a0a62-f58c-4769-a067-e64f944d5019 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:32.492803 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f91a0a62-f58c-4769-a067-e64f944d5019 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1739 microversion: 2.20 time: 0.572002 Jun 30 16:36:32.496523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 174/339] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:31 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1739 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:32.499896 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-a493dd7d-af5f-4744-ab0d-fb5849c21d91 req-9256244b-b2a1-41d6-b849-5fd23e1212a6 service nova] Creating event network-vif-plugged:237f85c7-d517-4bd7-9b4c-cfb1b755a321 for instance d786bea4-1a92-4eaf-8450-f69f05986687 on hv-cinder-83602 Jun 30 16:36:32.510441 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a3828b12-daa3-4ca2-8e43-d96684ff068f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:32.511243 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a3828b12-daa3-4ca2-8e43-d96684ff068f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:32.523030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-a493dd7d-af5f-4744-ab0d-fb5849c21d91 req-9256244b-b2a1-41d6-b849-5fd23e1212a6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092800 Jun 30 16:36:32.525600 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 166/340] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:36:32.548414 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a3828b12-daa3-4ca2-8e43-d96684ff068f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:32.548935 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a3828b12-daa3-4ca2-8e43-d96684ff068f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:32.571797 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a3828b12-daa3-4ca2-8e43-d96684ff068f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:32.571797 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a3828b12-daa3-4ca2-8e43-d96684ff068f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:33.130119 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a3828b12-daa3-4ca2-8e43-d96684ff068f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:33.165722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a3828b12-daa3-4ca2-8e43-d96684ff068f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1722 microversion: 2.1 time: 0.664646 Jun 30 16:36:33.167993 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 175/341] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:32 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1722 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:33.450768 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2fca3c49-8b8a-4f2d-a6a1-4cad94cbd0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:33.452280 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2fca3c49-8b8a-4f2d-a6a1-4cad94cbd0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:33.494712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2fca3c49-8b8a-4f2d-a6a1-4cad94cbd0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:33.499179 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2fca3c49-8b8a-4f2d-a6a1-4cad94cbd0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:33.501186 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2fca3c49-8b8a-4f2d-a6a1-4cad94cbd0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:33.505438 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2fca3c49-8b8a-4f2d-a6a1-4cad94cbd0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:33.534413 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1e9af3a0-b68a-4b95-9fcb-69a1b821c6fd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:33.545027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-1e9af3a0-b68a-4b95-9fcb-69a1b821c6fd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:33.592296 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1e9af3a0-b68a-4b95-9fcb-69a1b821c6fd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:33.608516 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1e9af3a0-b68a-4b95-9fcb-69a1b821c6fd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:33.610709 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1e9af3a0-b68a-4b95-9fcb-69a1b821c6fd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:33.612091 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1e9af3a0-b68a-4b95-9fcb-69a1b821c6fd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:35.142995 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2fca3c49-8b8a-4f2d-a6a1-4cad94cbd0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:35.156170 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2fca3c49-8b8a-4f2d-a6a1-4cad94cbd0d8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1371 microversion: 2.1 time: 1.721041 Jun 30 16:36:35.159670 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 167/342] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:33 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1371 bytes in 1726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:35.164528 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-bba04850-9c86-416c-97be-1a8b0eba4860 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:35.164761 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-1e9af3a0-b68a-4b95-9fcb-69a1b821c6fd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:35.165553 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-bba04850-9c86-416c-97be-1a8b0eba4860 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:35.181582 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-1e9af3a0-b68a-4b95-9fcb-69a1b821c6fd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:35.181582 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-1e9af3a0-b68a-4b95-9fcb-69a1b821c6fd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:35.182168 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-1e9af3a0-b68a-4b95-9fcb-69a1b821c6fd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1739 microversion: 2.20 time: 1.656117 Jun 30 16:36:35.183236 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 176/343] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:33 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1739 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:35.187293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bba04850-9c86-416c-97be-1a8b0eba4860 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:35.187790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bba04850-9c86-416c-97be-1a8b0eba4860 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:35.188578 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bba04850-9c86-416c-97be-1a8b0eba4860 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:35.189032 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bba04850-9c86-416c-97be-1a8b0eba4860 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:35.189828 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-f3e84c78-2503-4cd8-b178-1444335775f4 req-8021dc86-b029-444b-950d-43bfaa4a0baf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1f1412-017f-448b-a6bb-21d09d668a46", "name": "network-vif-plugged", "status": "completed", "tag": "feb9d98a-c1aa-45cf-b1e3-06597d656e69"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:35.202577 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-f3e84c78-2503-4cd8-b178-1444335775f4 req-8021dc86-b029-444b-950d-43bfaa4a0baf service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:35.203358 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-f3e84c78-2503-4cd8-b178-1444335775f4 req-8021dc86-b029-444b-950d-43bfaa4a0baf service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:35.228399 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-f3e84c78-2503-4cd8-b178-1444335775f4 req-8021dc86-b029-444b-950d-43bfaa4a0baf service nova] Creating event network-vif-plugged:feb9d98a-c1aa-45cf-b1e3-06597d656e69 for instance ab1f1412-017f-448b-a6bb-21d09d668a46 on hv-cinder-83602 Jun 30 16:36:35.236765 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-f3e84c78-2503-4cd8-b178-1444335775f4 req-8021dc86-b029-444b-950d-43bfaa4a0baf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051725 Jun 30 16:36:35.260796 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 177/344] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:36:35.903067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-bba04850-9c86-416c-97be-1a8b0eba4860 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:35.919336 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-bba04850-9c86-416c-97be-1a8b0eba4860 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1722 microversion: 2.1 time: 0.758397 Jun 30 16:36:35.921785 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 168/345] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:35 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1722 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:36.179867 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c2dbb71d-7afc-4367-aad0-cca7d1944961 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:36.182628 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c2dbb71d-7afc-4367-aad0-cca7d1944961 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:36.191171 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c2dbb71d-7afc-4367-aad0-cca7d1944961 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:36.193142 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c2dbb71d-7afc-4367-aad0-cca7d1944961 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:36.194114 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c2dbb71d-7afc-4367-aad0-cca7d1944961 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:36.194593 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c2dbb71d-7afc-4367-aad0-cca7d1944961 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:36.206723 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b6a5e6ce-3dc6-4e16-b89f-b6de3c6e8c64 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:36.209218 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b6a5e6ce-3dc6-4e16-b89f-b6de3c6e8c64 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:36.219687 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b6a5e6ce-3dc6-4e16-b89f-b6de3c6e8c64 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:36.220428 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b6a5e6ce-3dc6-4e16-b89f-b6de3c6e8c64 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:36.225551 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b6a5e6ce-3dc6-4e16-b89f-b6de3c6e8c64 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:36.226266 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b6a5e6ce-3dc6-4e16-b89f-b6de3c6e8c64 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:36.599127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b6a5e6ce-3dc6-4e16-b89f-b6de3c6e8c64 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:36.619847 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b6a5e6ce-3dc6-4e16-b89f-b6de3c6e8c64 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:36.622215 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b6a5e6ce-3dc6-4e16-b89f-b6de3c6e8c64 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:36.623627 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b6a5e6ce-3dc6-4e16-b89f-b6de3c6e8c64 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1739 microversion: 2.20 time: 0.421695 Jun 30 16:36:36.624197 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 169/346] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:36 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1739 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:36.693629 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c2dbb71d-7afc-4367-aad0-cca7d1944961 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:36.724679 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c2dbb71d-7afc-4367-aad0-cca7d1944961 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1564 microversion: 2.1 time: 0.549726 Jun 30 16:36:36.725856 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 178/347] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:36 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1564 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:36.742126 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7ce80f60-2071-407a-8143-bcaf7f6487f9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:36.742918 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-7ce80f60-2071-407a-8143-bcaf7f6487f9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:36.749812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7ce80f60-2071-407a-8143-bcaf7f6487f9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:36.750400 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7ce80f60-2071-407a-8143-bcaf7f6487f9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:36.751076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7ce80f60-2071-407a-8143-bcaf7f6487f9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:36.751723 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7ce80f60-2071-407a-8143-bcaf7f6487f9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:36.941919 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-13fe0cd7-9455-422c-bbf8-4c379ac60843 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:36.943262 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-13fe0cd7-9455-422c-bbf8-4c379ac60843 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:36.967071 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-13fe0cd7-9455-422c-bbf8-4c379ac60843 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:36.968476 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-13fe0cd7-9455-422c-bbf8-4c379ac60843 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:36.968735 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7ce80f60-2071-407a-8143-bcaf7f6487f9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.230840 Jun 30 16:36:36.975694 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-13fe0cd7-9455-422c-bbf8-4c379ac60843 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:36.977084 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 170/348] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 30 16:36:36 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-interface => generated 285 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:36:36.990675 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-13fe0cd7-9455-422c-bbf8-4c379ac60843 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:37.627121 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-13fe0cd7-9455-422c-bbf8-4c379ac60843 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:37.640922 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-13fe0cd7-9455-422c-bbf8-4c379ac60843 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1722 microversion: 2.1 time: 0.705830 Jun 30 16:36:37.642978 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8b9879e9-d3e6-4c65-b24b-1ce8f0d38184 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:37.643632 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8b9879e9-d3e6-4c65-b24b-1ce8f0d38184 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:37.649709 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 179/349] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:36 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1722 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:37.659258 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8b9879e9-d3e6-4c65-b24b-1ce8f0d38184 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:37.662827 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8b9879e9-d3e6-4c65-b24b-1ce8f0d38184 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:37.664401 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8b9879e9-d3e6-4c65-b24b-1ce8f0d38184 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:37.671937 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8b9879e9-d3e6-4c65-b24b-1ce8f0d38184 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:38.085049 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8b9879e9-d3e6-4c65-b24b-1ce8f0d38184 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:38.092508 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8b9879e9-d3e6-4c65-b24b-1ce8f0d38184 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:38.109271 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8b9879e9-d3e6-4c65-b24b-1ce8f0d38184 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:38.118242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8b9879e9-d3e6-4c65-b24b-1ce8f0d38184 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1739 microversion: 2.20 time: 0.472066 Jun 30 16:36:38.122242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 171/350] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:37 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1739 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:36:38.668118 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ddba524c-8a1b-470f-873a-37769a2de2d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:38.669690 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ddba524c-8a1b-470f-873a-37769a2de2d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:38.692578 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ddba524c-8a1b-470f-873a-37769a2de2d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:38.693724 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ddba524c-8a1b-470f-873a-37769a2de2d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:38.694858 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ddba524c-8a1b-470f-873a-37769a2de2d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:38.695622 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ddba524c-8a1b-470f-873a-37769a2de2d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:39.138488 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-34283ab9-d703-43b8-9bac-4e3b13613168 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:39.139118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-34283ab9-d703-43b8-9bac-4e3b13613168 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:39.161187 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-34283ab9-d703-43b8-9bac-4e3b13613168 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:39.161681 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-34283ab9-d703-43b8-9bac-4e3b13613168 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:39.165122 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-34283ab9-d703-43b8-9bac-4e3b13613168 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:39.166606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-34283ab9-d703-43b8-9bac-4e3b13613168 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:39.837212 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ddba524c-8a1b-470f-873a-37769a2de2d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:39.846204 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ddba524c-8a1b-470f-873a-37769a2de2d4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1722 microversion: 2.1 time: 1.182989 Jun 30 16:36:39.858464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 180/351] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:38 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1722 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:39.876015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-5fe37ac4-d07a-43e7-bc46-266e84649ac2 req-c3390692-884c-4490-9c26-154644112395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d786bea4-1a92-4eaf-8450-f69f05986687", "tag": "237f85c7-d517-4bd7-9b4c-cfb1b755a321"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:39.916079 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-5fe37ac4-d07a-43e7-bc46-266e84649ac2 req-c3390692-884c-4490-9c26-154644112395 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:39.916806 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-5fe37ac4-d07a-43e7-bc46-266e84649ac2 req-c3390692-884c-4490-9c26-154644112395 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:39.945948 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-5fe37ac4-d07a-43e7-bc46-266e84649ac2 req-c3390692-884c-4490-9c26-154644112395 service nova] Creating event network-changed:237f85c7-d517-4bd7-9b4c-cfb1b755a321 for instance d786bea4-1a92-4eaf-8450-f69f05986687 on hv-cinder-83602 Jun 30 16:36:39.952456 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-5fe37ac4-d07a-43e7-bc46-266e84649ac2 req-c3390692-884c-4490-9c26-154644112395 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090596 Jun 30 16:36:39.963187 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 181/352] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:36:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:36:40.276770 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-34283ab9-d703-43b8-9bac-4e3b13613168 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:40.299709 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-34283ab9-d703-43b8-9bac-4e3b13613168 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:40.313617 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-34283ab9-d703-43b8-9bac-4e3b13613168 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:40.316005 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-34283ab9-d703-43b8-9bac-4e3b13613168 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1739 microversion: 2.20 time: 1.180983 Jun 30 16:36:40.317379 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 172/353] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:39 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1739 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:36:40.868422 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c7aba7ae-55d8-4923-92ce-e9b6615dcafd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:40.870965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c7aba7ae-55d8-4923-92ce-e9b6615dcafd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:40.884935 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c7aba7ae-55d8-4923-92ce-e9b6615dcafd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:40.890243 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c7aba7ae-55d8-4923-92ce-e9b6615dcafd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:40.890243 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c7aba7ae-55d8-4923-92ce-e9b6615dcafd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:40.890243 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c7aba7ae-55d8-4923-92ce-e9b6615dcafd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:41.358221 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9ec6586a-9f63-4f84-8fa1-995308e22228 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:41.363202 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9ec6586a-9f63-4f84-8fa1-995308e22228 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:41.380955 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9ec6586a-9f63-4f84-8fa1-995308e22228 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:41.382106 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9ec6586a-9f63-4f84-8fa1-995308e22228 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:41.383156 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9ec6586a-9f63-4f84-8fa1-995308e22228 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:41.383983 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9ec6586a-9f63-4f84-8fa1-995308e22228 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:41.568832 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c7aba7ae-55d8-4923-92ce-e9b6615dcafd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:41.589099 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c7aba7ae-55d8-4923-92ce-e9b6615dcafd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1722 microversion: 2.1 time: 0.723284 Jun 30 16:36:41.597234 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 182/354] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:40 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1722 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:41.713920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9ec6586a-9f63-4f84-8fa1-995308e22228 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:41.730059 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9ec6586a-9f63-4f84-8fa1-995308e22228 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:41.734340 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9ec6586a-9f63-4f84-8fa1-995308e22228 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:41.738387 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9ec6586a-9f63-4f84-8fa1-995308e22228 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1739 microversion: 2.20 time: 0.394068 Jun 30 16:36:41.743241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 173/355] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:41 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1739 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:42.617817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-88ccd7d6-65e8-4d5a-9394-f1f4c9a147cd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:42.619378 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-88ccd7d6-65e8-4d5a-9394-f1f4c9a147cd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:42.634717 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-88ccd7d6-65e8-4d5a-9394-f1f4c9a147cd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:42.635877 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-88ccd7d6-65e8-4d5a-9394-f1f4c9a147cd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:42.638122 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-88ccd7d6-65e8-4d5a-9394-f1f4c9a147cd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:42.638824 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-88ccd7d6-65e8-4d5a-9394-f1f4c9a147cd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:42.760941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-55227f0e-b51d-4035-b38a-ff732196e917 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:42.762364 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-55227f0e-b51d-4035-b38a-ff732196e917 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:42.777970 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-55227f0e-b51d-4035-b38a-ff732196e917 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:42.778440 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-55227f0e-b51d-4035-b38a-ff732196e917 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:42.784650 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-55227f0e-b51d-4035-b38a-ff732196e917 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:42.785221 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-55227f0e-b51d-4035-b38a-ff732196e917 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:43.773088 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-88ccd7d6-65e8-4d5a-9394-f1f4c9a147cd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:43.806654 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-88ccd7d6-65e8-4d5a-9394-f1f4c9a147cd tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1699 microversion: 2.1 time: 1.199396 Jun 30 16:36:43.810363 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 183/356] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:42 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1699 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:43.856098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-55227f0e-b51d-4035-b38a-ff732196e917 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:43.896971 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-55227f0e-b51d-4035-b38a-ff732196e917 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:43.900295 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-55227f0e-b51d-4035-b38a-ff732196e917 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:43.901746 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-55227f0e-b51d-4035-b38a-ff732196e917 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1739 microversion: 2.20 time: 1.144928 Jun 30 16:36:43.906005 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 174/357] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:42 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1739 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:36:43.924089 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-eb023b7e-00f9-4527-ab19-3ce0383f4cc1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:43.941255 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-eb023b7e-00f9-4527-ab19-3ce0383f4cc1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:43.944252 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-eb023b7e-00f9-4527-ab19-3ce0383f4cc1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:44.024675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-eb023b7e-00f9-4527-ab19-3ce0383f4cc1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Going to try to start instance {{(pid=124815) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 16:36:44.272520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-eb023b7e-00f9-4527-ab19-3ce0383f4cc1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "POST /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/action" status: 202 len: 0 microversion: 2.1 time: 0.364126 Jun 30 16:36:44.277543 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 175/358] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 30 16:36:43 2022] POST /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:36:44.308439 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-fe78e960-7b1c-4a8c-9ab5-9f2f7d2c0892 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57cc5c63-bb7a-4829-926c-65930dfc71b2", "device": "/dev/sdb"}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:44.324143 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-fe78e960-7b1c-4a8c-9ab5-9f2f7d2c0892 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:44.354257 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe78e960-7b1c-4a8c-9ab5-9f2f7d2c0892 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:44.371624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe78e960-7b1c-4a8c-9ab5-9f2f7d2c0892 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:44.380820 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe78e960-7b1c-4a8c-9ab5-9f2f7d2c0892 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:44.380820 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe78e960-7b1c-4a8c-9ab5-9f2f7d2c0892 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:44.879335 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-487348ed-0a83-4fba-8c88-966c0d89ebb9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Action: 'create', calling method: .version_select at 0x7f38203943a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1708708675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi8HjTtNjrkam2gYJ+TrxsdfvGg2R3wt8HmgwKyXGQ+OV6T8Dl23/PMqROWeZ4mRZk84f8BBAgMKg57JMaLZkottkeQ09sfKqhu1iPwCuleXkgY0Y5Rxt58Wv807vnuYQ=="}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:44.930294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-487348ed-0a83-4fba-8c88-966c0d89ebb9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Getting quotas for project 19b35fc495a345898167db62b9b95887. Resources: {'key_pairs'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:36:44.950413 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-487348ed-0a83-4fba-8c88-966c0d89ebb9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Getting quotas for user b1a5d200007a4474a2a25d2ae0915c14 and project 19b35fc495a345898167db62b9b95887. Resources: {'key_pairs'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:36:45.146452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-487348ed-0a83-4fba-8c88-966c0d89ebb9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.331129 Jun 30 16:36:45.153447 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 184/359] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 30 16:36:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:36:45.159612 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7295d69b-2ce9-4c9f-b8b8-9249e799c302 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:45.165176 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7295d69b-2ce9-4c9f-b8b8-9249e799c302 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:45.186987 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7295d69b-2ce9-4c9f-b8b8-9249e799c302 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:45.188089 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7295d69b-2ce9-4c9f-b8b8-9249e799c302 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:45.189167 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7295d69b-2ce9-4c9f-b8b8-9249e799c302 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:45.194197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7295d69b-2ce9-4c9f-b8b8-9249e799c302 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:45.683017 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7295d69b-2ce9-4c9f-b8b8-9249e799c302 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:45.696885 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7295d69b-2ce9-4c9f-b8b8-9249e799c302 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1708 microversion: 2.1 time: 0.541533 Jun 30 16:36:45.697820 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 185/360] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:45 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1708 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:45.725985 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-12cde9d0-90fc-4607-a5cd-858fbbe831b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:45.726614 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-12cde9d0-90fc-4607-a5cd-858fbbe831b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:45.747788 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12cde9d0-90fc-4607-a5cd-858fbbe831b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:45.753075 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12cde9d0-90fc-4607-a5cd-858fbbe831b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:45.754419 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12cde9d0-90fc-4607-a5cd-858fbbe831b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:45.756571 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12cde9d0-90fc-4607-a5cd-858fbbe831b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:45.778186 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-fe78e960-7b1c-4a8c-9ab5-9f2f7d2c0892 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "POST /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.480006 Jun 30 16:36:45.785584 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 176/361] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 30 16:36:44 2022] POST /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f/os-volume_attachments => generated 194 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:36:46.728939 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f9df8a68-bb13-4fc5-a222-d955c4d3a910 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:46.730119 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f9df8a68-bb13-4fc5-a222-d955c4d3a910 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:46.749568 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-12cde9d0-90fc-4607-a5cd-858fbbe831b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:46.754995 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f9df8a68-bb13-4fc5-a222-d955c4d3a910 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:46.758744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f9df8a68-bb13-4fc5-a222-d955c4d3a910 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:46.760327 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f9df8a68-bb13-4fc5-a222-d955c4d3a910 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:46.761153 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f9df8a68-bb13-4fc5-a222-d955c4d3a910 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:46.766023 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-12cde9d0-90fc-4607-a5cd-858fbbe831b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:46.773956 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-12cde9d0-90fc-4607-a5cd-858fbbe831b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:46.773956 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-12cde9d0-90fc-4607-a5cd-858fbbe831b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1739 microversion: 2.20 time: 1.073522 Jun 30 16:36:46.773956 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 186/362] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:45 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1739 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:46.815305 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:47.070007 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f9df8a68-bb13-4fc5-a222-d955c4d3a910 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:47.087641 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f9df8a68-bb13-4fc5-a222-d955c4d3a910 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1708 microversion: 2.1 time: 0.364596 Jun 30 16:36:47.093044 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 177/363] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:46 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1708 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:47.756714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1247908324", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452"}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:47.765886 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:47.794454 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-5a6aef93-f94b-4c0f-b268-bf5a27080c4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:47.796572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-5a6aef93-f94b-4c0f-b268-bf5a27080c4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:47.808322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5a6aef93-f94b-4c0f-b268-bf5a27080c4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:47.812507 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5a6aef93-f94b-4c0f-b268-bf5a27080c4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:47.815242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5a6aef93-f94b-4c0f-b268-bf5a27080c4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:47.815242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5a6aef93-f94b-4c0f-b268-bf5a27080c4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:47.826401 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.network.neutron [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] validate_networks() for None {{(pid=124814) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:36:48.319743 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5a6aef93-f94b-4c0f-b268-bf5a27080c4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:48.336498 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5a6aef93-f94b-4c0f-b268-bf5a27080c4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:48.338304 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5a6aef93-f94b-4c0f-b268-bf5a27080c4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:48.339703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-5a6aef93-f94b-4c0f-b268-bf5a27080c4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1739 microversion: 2.20 time: 0.551329 Jun 30 16:36:48.347202 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 178/364] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:47 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1739 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:48.366577 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a92eec94-ca34-4d6b-a9d6-424c20b4bbbb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:48.370491 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a92eec94-ca34-4d6b-a9d6-424c20b4bbbb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:48.377555 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a92eec94-ca34-4d6b-a9d6-424c20b4bbbb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:48.378449 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a92eec94-ca34-4d6b-a9d6-424c20b4bbbb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:48.379324 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a92eec94-ca34-4d6b-a9d6-424c20b4bbbb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:48.380036 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a92eec94-ca34-4d6b-a9d6-424c20b4bbbb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:48.460026 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Flavor limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:36:48.460479 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Image limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:36:48.460973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Flavor pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:36:48.461395 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Image pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:36:48.461805 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:36:48.472212 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:48.472939 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:48.474140 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:48.475686 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:48.497804 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Getting quotas for project 62ec9078457f461db05068580817ab69. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:36:48.502254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Getting quotas for user 936a4ad02f06446f90bea6d95eb17b70 and project 62ec9078457f461db05068580817ab69. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:36:48.514521 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Going to run 1 instances... {{(pid=124814) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:36:48.516927 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:36:48.588810 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a92eec94-ca34-4d6b-a9d6-424c20b4bbbb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:48.600428 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a92eec94-ca34-4d6b-a9d6-424c20b4bbbb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1708 microversion: 2.1 time: 0.246906 Jun 30 16:36:48.601577 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 179/365] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:48 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1708 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:49.022333 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-cb110289-3130-410f-b84a-3c65b273f33d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.274494 Jun 30 16:36:49.036107 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 187/366] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:36:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 16:36:49.036814 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-538fb3f7-c698-47c0-899b-b575c7f88d32 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:49.036814 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-538fb3f7-c698-47c0-899b-b575c7f88d32 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:49.134122 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-538fb3f7-c698-47c0-899b-b575c7f88d32 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:49.154722 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-538fb3f7-c698-47c0-899b-b575c7f88d32 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1215 microversion: 2.1 time: 0.125047 Jun 30 16:36:49.167974 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 180/367] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:49 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1215 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:49.369271 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-25c8b8e5-94ce-49f7-8d5d-146ad814bcd3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:49.370355 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-25c8b8e5-94ce-49f7-8d5d-146ad814bcd3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:49.377899 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-25c8b8e5-94ce-49f7-8d5d-146ad814bcd3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:49.378347 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-25c8b8e5-94ce-49f7-8d5d-146ad814bcd3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:49.379191 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-25c8b8e5-94ce-49f7-8d5d-146ad814bcd3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:49.379985 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-25c8b8e5-94ce-49f7-8d5d-146ad814bcd3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:49.591730 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-25c8b8e5-94ce-49f7-8d5d-146ad814bcd3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:49.602827 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-25c8b8e5-94ce-49f7-8d5d-146ad814bcd3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:49.604510 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-25c8b8e5-94ce-49f7-8d5d-146ad814bcd3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:49.605791 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-25c8b8e5-94ce-49f7-8d5d-146ad814bcd3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1739 microversion: 2.20 time: 0.241928 Jun 30 16:36:49.609641 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 188/368] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:49 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:49.620527 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ef53b2d8-62a3-4220-bcc2-4f0f46b1fa05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:49.627727 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ef53b2d8-62a3-4220-bcc2-4f0f46b1fa05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:49.635583 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ef53b2d8-62a3-4220-bcc2-4f0f46b1fa05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:49.636049 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ef53b2d8-62a3-4220-bcc2-4f0f46b1fa05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:49.637264 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ef53b2d8-62a3-4220-bcc2-4f0f46b1fa05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:49.637890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ef53b2d8-62a3-4220-bcc2-4f0f46b1fa05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:49.919247 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ef53b2d8-62a3-4220-bcc2-4f0f46b1fa05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:49.954248 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ef53b2d8-62a3-4220-bcc2-4f0f46b1fa05 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1712 microversion: 2.1 time: 0.339689 Jun 30 16:36:49.955691 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 181/369] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:49 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1712 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:50.175517 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6c2dd8df-5997-49ee-ab24-e53c75ab88d1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:50.176818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6c2dd8df-5997-49ee-ab24-e53c75ab88d1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:50.314555 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6c2dd8df-5997-49ee-ab24-e53c75ab88d1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:50.326411 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6c2dd8df-5997-49ee-ab24-e53c75ab88d1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1215 microversion: 2.1 time: 0.155936 Jun 30 16:36:50.328005 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 189/370] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:50 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1215 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:50.627085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-fd5ae494-aa99-4965-812f-0c2305a5f681 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:50.628389 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-fd5ae494-aa99-4965-812f-0c2305a5f681 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:50.643353 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fd5ae494-aa99-4965-812f-0c2305a5f681 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:50.643353 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fd5ae494-aa99-4965-812f-0c2305a5f681 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:50.643353 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fd5ae494-aa99-4965-812f-0c2305a5f681 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:50.643353 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fd5ae494-aa99-4965-812f-0c2305a5f681 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:51.032022 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-fd5ae494-aa99-4965-812f-0c2305a5f681 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:51.057484 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-fd5ae494-aa99-4965-812f-0c2305a5f681 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:51.064704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-fd5ae494-aa99-4965-812f-0c2305a5f681 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:51.068896 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-fd5ae494-aa99-4965-812f-0c2305a5f681 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1739 microversion: 2.20 time: 0.446821 Jun 30 16:36:51.082983 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 182/371] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:50 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1739 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:51.369436 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d7d25269-432e-491b-8f3d-6cec6f720dfe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:51.370167 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d7d25269-432e-491b-8f3d-6cec6f720dfe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:51.391022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d7d25269-432e-491b-8f3d-6cec6f720dfe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:51.395678 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d7d25269-432e-491b-8f3d-6cec6f720dfe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:51.399621 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d7d25269-432e-491b-8f3d-6cec6f720dfe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:51.400222 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d7d25269-432e-491b-8f3d-6cec6f720dfe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:51.528708 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d7d25269-432e-491b-8f3d-6cec6f720dfe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:51.544105 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d7d25269-432e-491b-8f3d-6cec6f720dfe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1211 microversion: 2.1 time: 0.194131 Jun 30 16:36:51.556329 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 190/372] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:51 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1211 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:52.095270 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-04fba92b-2661-4f21-b424-080981aaf3d2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:52.096637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-04fba92b-2661-4f21-b424-080981aaf3d2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:52.102495 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=64 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:52.110601 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-04fba92b-2661-4f21-b424-080981aaf3d2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:52.111444 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-04fba92b-2661-4f21-b424-080981aaf3d2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:52.112563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-04fba92b-2661-4f21-b424-080981aaf3d2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:52.114521 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-04fba92b-2661-4f21-b424-080981aaf3d2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:52.385095 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-04fba92b-2661-4f21-b424-080981aaf3d2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:52.385095 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-04fba92b-2661-4f21-b424-080981aaf3d2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:52.385630 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-04fba92b-2661-4f21-b424-080981aaf3d2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:52.385630 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-04fba92b-2661-4f21-b424-080981aaf3d2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1739 microversion: 2.20 time: 0.297111 Jun 30 16:36:52.385630 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 183/373] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:52 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:52.571183 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0e600594-a633-4559-8e1d-b7183a78ca39 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:52.572283 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0e600594-a633-4559-8e1d-b7183a78ca39 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:52.581639 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0e600594-a633-4559-8e1d-b7183a78ca39 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:52.596559 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0e600594-a633-4559-8e1d-b7183a78ca39 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:52.596559 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0e600594-a633-4559-8e1d-b7183a78ca39 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:52.596559 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0e600594-a633-4559-8e1d-b7183a78ca39 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:52.676621 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0e600594-a633-4559-8e1d-b7183a78ca39 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:52.686628 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0e600594-a633-4559-8e1d-b7183a78ca39 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1267 microversion: 2.1 time: 0.123009 Jun 30 16:36:52.687541 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 191/374] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:52 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:53.403931 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-5cd56696-3d7e-4714-b749-796937a32db4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:53.404550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-5cd56696-3d7e-4714-b749-796937a32db4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:53.411381 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5cd56696-3d7e-4714-b749-796937a32db4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:53.414134 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5cd56696-3d7e-4714-b749-796937a32db4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:53.414134 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5cd56696-3d7e-4714-b749-796937a32db4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:53.414134 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5cd56696-3d7e-4714-b749-796937a32db4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:53.655319 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5cd56696-3d7e-4714-b749-796937a32db4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:53.665844 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5cd56696-3d7e-4714-b749-796937a32db4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:53.667779 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5cd56696-3d7e-4714-b749-796937a32db4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:53.669469 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-5cd56696-3d7e-4714-b749-796937a32db4 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1739 microversion: 2.20 time: 0.269354 Jun 30 16:36:53.670731 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 184/375] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:53 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:53.706631 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-22949f4e-0d51-40d8-863b-bdd3518147be tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:53.708362 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-22949f4e-0d51-40d8-863b-bdd3518147be tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:53.733452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-22949f4e-0d51-40d8-863b-bdd3518147be tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:53.735770 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-22949f4e-0d51-40d8-863b-bdd3518147be tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:53.739714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-22949f4e-0d51-40d8-863b-bdd3518147be tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:53.742642 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-22949f4e-0d51-40d8-863b-bdd3518147be tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:53.848316 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-22949f4e-0d51-40d8-863b-bdd3518147be tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:53.860742 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-22949f4e-0d51-40d8-863b-bdd3518147be tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1275 microversion: 2.1 time: 0.158574 Jun 30 16:36:53.861973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 192/376] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:53 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1275 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:54.689723 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9e41ecd7-dfd0-427b-ab29-c015efc59933 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:54.690325 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9e41ecd7-dfd0-427b-ab29-c015efc59933 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:54.698356 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9e41ecd7-dfd0-427b-ab29-c015efc59933 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:54.698822 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9e41ecd7-dfd0-427b-ab29-c015efc59933 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:54.699761 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9e41ecd7-dfd0-427b-ab29-c015efc59933 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:54.700265 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9e41ecd7-dfd0-427b-ab29-c015efc59933 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:54.849530 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9e41ecd7-dfd0-427b-ab29-c015efc59933 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:54.859819 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9e41ecd7-dfd0-427b-ab29-c015efc59933 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:54.861900 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9e41ecd7-dfd0-427b-ab29-c015efc59933 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:54.863242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9e41ecd7-dfd0-427b-ab29-c015efc59933 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1739 microversion: 2.20 time: 0.178369 Jun 30 16:36:54.868050 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 185/377] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:54 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:54.887109 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9c6a2093-bc5f-4a97-9dc7-c599a2d8408c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:54.887980 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9c6a2093-bc5f-4a97-9dc7-c599a2d8408c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:54.895904 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9c6a2093-bc5f-4a97-9dc7-c599a2d8408c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:54.896333 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9c6a2093-bc5f-4a97-9dc7-c599a2d8408c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:54.897531 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9c6a2093-bc5f-4a97-9dc7-c599a2d8408c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:54.898190 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9c6a2093-bc5f-4a97-9dc7-c599a2d8408c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:54.974359 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9c6a2093-bc5f-4a97-9dc7-c599a2d8408c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:54.977392 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=100 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:54.988105 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9c6a2093-bc5f-4a97-9dc7-c599a2d8408c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1273 microversion: 2.1 time: 0.100932 Jun 30 16:36:54.988105 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 193/378] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:54 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1273 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:55.882812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2860bb3e-9940-475a-86ac-2b272b58f3f2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:55.883462 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2860bb3e-9940-475a-86ac-2b272b58f3f2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:55.890030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2860bb3e-9940-475a-86ac-2b272b58f3f2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:55.890484 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2860bb3e-9940-475a-86ac-2b272b58f3f2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:55.891315 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2860bb3e-9940-475a-86ac-2b272b58f3f2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:55.892083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2860bb3e-9940-475a-86ac-2b272b58f3f2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:56.003940 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-18afd69e-219d-4949-acf2-b7eeccec6c04 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:56.012382 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-18afd69e-219d-4949-acf2-b7eeccec6c04 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:56.024270 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-18afd69e-219d-4949-acf2-b7eeccec6c04 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:56.024738 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-18afd69e-219d-4949-acf2-b7eeccec6c04 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:56.025557 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-18afd69e-219d-4949-acf2-b7eeccec6c04 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:56.025998 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-18afd69e-219d-4949-acf2-b7eeccec6c04 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:56.064215 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2860bb3e-9940-475a-86ac-2b272b58f3f2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:56.074356 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2860bb3e-9940-475a-86ac-2b272b58f3f2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:56.075912 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2860bb3e-9940-475a-86ac-2b272b58f3f2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:56.077091 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2860bb3e-9940-475a-86ac-2b272b58f3f2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1721 microversion: 2.20 time: 0.198757 Jun 30 16:36:56.077648 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 186/379] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:55 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:56.191211 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-18afd69e-219d-4949-acf2-b7eeccec6c04 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:56.228129 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-18afd69e-219d-4949-acf2-b7eeccec6c04 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.229309 Jun 30 16:36:56.235726 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 194/380] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:55 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:56.700189 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-ceddc3c4-894a-4941-826f-25eca46cae33 req-9adfbd80-7a63-498f-a99c-3e73a361fa31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "857e209a-1b96-4de8-aae0-f4b0091275c7", "tag": "2cd6c343-43aa-4c82-90b3-e348a6daf264"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:56.714194 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-ceddc3c4-894a-4941-826f-25eca46cae33 req-9adfbd80-7a63-498f-a99c-3e73a361fa31 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:56.714816 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-ceddc3c4-894a-4941-826f-25eca46cae33 req-9adfbd80-7a63-498f-a99c-3e73a361fa31 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:56.729966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-ceddc3c4-894a-4941-826f-25eca46cae33 req-9adfbd80-7a63-498f-a99c-3e73a361fa31 service nova] Creating event network-changed:2cd6c343-43aa-4c82-90b3-e348a6daf264 for instance 857e209a-1b96-4de8-aae0-f4b0091275c7 on hv-cinder-83602 Jun 30 16:36:56.746133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-ceddc3c4-894a-4941-826f-25eca46cae33 req-9adfbd80-7a63-498f-a99c-3e73a361fa31 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049163 Jun 30 16:36:56.746986 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 187/381] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:36:57.101286 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-149e63e9-25fd-4df3-9a2e-2f15b878561c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:57.102075 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-149e63e9-25fd-4df3-9a2e-2f15b878561c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:57.108703 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-149e63e9-25fd-4df3-9a2e-2f15b878561c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:57.109203 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-149e63e9-25fd-4df3-9a2e-2f15b878561c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:57.109937 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-149e63e9-25fd-4df3-9a2e-2f15b878561c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:57.110418 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-149e63e9-25fd-4df3-9a2e-2f15b878561c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:57.251825 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7b697b59-38f0-4d0a-82ed-7de9d264a67a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:57.252645 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-7b697b59-38f0-4d0a-82ed-7de9d264a67a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:57.257734 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-149e63e9-25fd-4df3-9a2e-2f15b878561c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:57.260768 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7b697b59-38f0-4d0a-82ed-7de9d264a67a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:57.261480 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7b697b59-38f0-4d0a-82ed-7de9d264a67a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:57.262395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7b697b59-38f0-4d0a-82ed-7de9d264a67a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:57.262941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7b697b59-38f0-4d0a-82ed-7de9d264a67a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:57.266372 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-149e63e9-25fd-4df3-9a2e-2f15b878561c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:57.267922 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-149e63e9-25fd-4df3-9a2e-2f15b878561c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:57.269140 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-149e63e9-25fd-4df3-9a2e-2f15b878561c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1721 microversion: 2.20 time: 0.171750 Jun 30 16:36:57.270189 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 195/382] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:57 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:57.404473 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-7b697b59-38f0-4d0a-82ed-7de9d264a67a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:57.412405 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7b697b59-38f0-4d0a-82ed-7de9d264a67a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.165776 Jun 30 16:36:57.413271 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 188/383] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:57 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:58.289352 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9422a4d7-29d4-4b99-9154-6f247fb548eb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:58.290158 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9422a4d7-29d4-4b99-9154-6f247fb548eb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:58.297228 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9422a4d7-29d4-4b99-9154-6f247fb548eb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:58.297680 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9422a4d7-29d4-4b99-9154-6f247fb548eb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:58.298571 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9422a4d7-29d4-4b99-9154-6f247fb548eb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:58.298926 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9422a4d7-29d4-4b99-9154-6f247fb548eb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:58.429702 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-faae148e-ebc9-4b2f-a665-eb4c09a30e22 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:58.431069 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-faae148e-ebc9-4b2f-a665-eb4c09a30e22 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:58.437394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-faae148e-ebc9-4b2f-a665-eb4c09a30e22 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:58.437854 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-faae148e-ebc9-4b2f-a665-eb4c09a30e22 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:58.438623 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-faae148e-ebc9-4b2f-a665-eb4c09a30e22 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:58.439072 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-faae148e-ebc9-4b2f-a665-eb4c09a30e22 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:58.440435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9422a4d7-29d4-4b99-9154-6f247fb548eb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:58.451079 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9422a4d7-29d4-4b99-9154-6f247fb548eb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:58.452613 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9422a4d7-29d4-4b99-9154-6f247fb548eb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:58.454218 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9422a4d7-29d4-4b99-9154-6f247fb548eb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1721 microversion: 2.20 time: 0.170013 Jun 30 16:36:58.454832 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 196/384] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:58 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:36:58.586225 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-faae148e-ebc9-4b2f-a665-eb4c09a30e22 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:58.594457 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-faae148e-ebc9-4b2f-a665-eb4c09a30e22 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.168432 Jun 30 16:36:58.594986 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 189/385] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:58 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:36:59.473883 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-b8aa9816-fda3-45bd-8931-b7cf3ce106ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:59.474589 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-b8aa9816-fda3-45bd-8931-b7cf3ce106ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:59.477007 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=2 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:59.482779 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b8aa9816-fda3-45bd-8931-b7cf3ce106ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:59.483230 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b8aa9816-fda3-45bd-8931-b7cf3ce106ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:59.484086 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b8aa9816-fda3-45bd-8931-b7cf3ce106ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:59.484525 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b8aa9816-fda3-45bd-8931-b7cf3ce106ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:59.611774 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6512da17-f7a4-4491-9ceb-1899c8d4fd5e tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:36:59.612493 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6512da17-f7a4-4491-9ceb-1899c8d4fd5e tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:36:59.614466 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:36:59.620719 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6512da17-f7a4-4491-9ceb-1899c8d4fd5e tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:59.621217 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6512da17-f7a4-4491-9ceb-1899c8d4fd5e tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:59.622046 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6512da17-f7a4-4491-9ceb-1899c8d4fd5e tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:59.622413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6512da17-f7a4-4491-9ceb-1899c8d4fd5e tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:36:59.623550 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b8aa9816-fda3-45bd-8931-b7cf3ce106ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:59.632262 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b8aa9816-fda3-45bd-8931-b7cf3ce106ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:59.634416 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b8aa9816-fda3-45bd-8931-b7cf3ce106ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:59.635860 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-b8aa9816-fda3-45bd-8931-b7cf3ce106ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1721 microversion: 2.20 time: 0.166118 Jun 30 16:36:59.636421 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 197/386] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:36:59 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:36:59.758656 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6512da17-f7a4-4491-9ceb-1899c8d4fd5e tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:36:59.766243 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6512da17-f7a4-4491-9ceb-1899c8d4fd5e tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.158357 Jun 30 16:36:59.768680 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 190/387] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:36:59 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:36:59.983890 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-28c2c592-42a5-47da-aa9a-97225e5f958d req-17f34a6a-3853-4271-839d-afe551c265f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1f1412-017f-448b-a6bb-21d09d668a46", "name": "network-vif-unplugged", "status": "completed", "tag": "feb9d98a-c1aa-45cf-b1e3-06597d656e69"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:36:59.992302 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-28c2c592-42a5-47da-aa9a-97225e5f958d req-17f34a6a-3853-4271-839d-afe551c265f5 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:36:59.992742 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-28c2c592-42a5-47da-aa9a-97225e5f958d req-17f34a6a-3853-4271-839d-afe551c265f5 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:00.006322 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-28c2c592-42a5-47da-aa9a-97225e5f958d req-17f34a6a-3853-4271-839d-afe551c265f5 service nova] Creating event network-vif-unplugged:feb9d98a-c1aa-45cf-b1e3-06597d656e69 for instance ab1f1412-017f-448b-a6bb-21d09d668a46 on hv-cinder-83602 Jun 30 16:37:00.011316 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-28c2c592-42a5-47da-aa9a-97225e5f958d req-17f34a6a-3853-4271-839d-afe551c265f5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031354 Jun 30 16:37:00.011935 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 198/388] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:37:00.656079 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c50cf35f-c255-4386-a1e8-d50bf02de18d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:00.657171 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c50cf35f-c255-4386-a1e8-d50bf02de18d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:00.666736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c50cf35f-c255-4386-a1e8-d50bf02de18d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:00.667195 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c50cf35f-c255-4386-a1e8-d50bf02de18d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:00.668008 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c50cf35f-c255-4386-a1e8-d50bf02de18d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:00.668449 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c50cf35f-c255-4386-a1e8-d50bf02de18d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:00.790215 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6d8c2d97-fe4e-461d-8126-4958e4999be5 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:00.791251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6d8c2d97-fe4e-461d-8126-4958e4999be5 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:00.794706 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=12 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:00.799319 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d8c2d97-fe4e-461d-8126-4958e4999be5 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:00.799805 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d8c2d97-fe4e-461d-8126-4958e4999be5 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:00.800619 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d8c2d97-fe4e-461d-8126-4958e4999be5 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:00.801084 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d8c2d97-fe4e-461d-8126-4958e4999be5 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:00.813341 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c50cf35f-c255-4386-a1e8-d50bf02de18d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:00.822037 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c50cf35f-c255-4386-a1e8-d50bf02de18d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:00.823553 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c50cf35f-c255-4386-a1e8-d50bf02de18d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:00.824707 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c50cf35f-c255-4386-a1e8-d50bf02de18d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1721 microversion: 2.20 time: 0.174549 Jun 30 16:37:00.825260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 191/389] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:00 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:00.949572 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6d8c2d97-fe4e-461d-8126-4958e4999be5 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:00.957259 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6d8c2d97-fe4e-461d-8126-4958e4999be5 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.176054 Jun 30 16:37:00.957838 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 199/390] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:00 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:01.842673 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-25b0a432-3015-4fe2-9ed6-0a060bbce68d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:01.843284 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-25b0a432-3015-4fe2-9ed6-0a060bbce68d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:01.850298 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-25b0a432-3015-4fe2-9ed6-0a060bbce68d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:01.850987 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-25b0a432-3015-4fe2-9ed6-0a060bbce68d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:01.851915 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-25b0a432-3015-4fe2-9ed6-0a060bbce68d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:01.852367 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-25b0a432-3015-4fe2-9ed6-0a060bbce68d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:01.973853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-398386b8-2aa1-40b6-b6b9-24d25c6b43e1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:01.977578 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-398386b8-2aa1-40b6-b6b9-24d25c6b43e1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:01.981562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-398386b8-2aa1-40b6-b6b9-24d25c6b43e1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:01.982020 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-398386b8-2aa1-40b6-b6b9-24d25c6b43e1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:01.982784 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-398386b8-2aa1-40b6-b6b9-24d25c6b43e1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:01.983220 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-398386b8-2aa1-40b6-b6b9-24d25c6b43e1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:01.995192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-25b0a432-3015-4fe2-9ed6-0a060bbce68d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:02.003595 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-25b0a432-3015-4fe2-9ed6-0a060bbce68d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:02.005361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-25b0a432-3015-4fe2-9ed6-0a060bbce68d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:02.006526 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-25b0a432-3015-4fe2-9ed6-0a060bbce68d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1721 microversion: 2.20 time: 0.167956 Jun 30 16:37:02.007823 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 192/391] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:01 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:02.120091 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-398386b8-2aa1-40b6-b6b9-24d25c6b43e1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:02.127498 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-398386b8-2aa1-40b6-b6b9-24d25c6b43e1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.157891 Jun 30 16:37:02.128049 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 200/392] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:01 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:03.025534 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-49429b6c-b57f-4e64-ba2b-8b67a1d51648 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:03.026165 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-49429b6c-b57f-4e64-ba2b-8b67a1d51648 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:03.032842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-49429b6c-b57f-4e64-ba2b-8b67a1d51648 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:03.033325 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-49429b6c-b57f-4e64-ba2b-8b67a1d51648 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:03.034128 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-49429b6c-b57f-4e64-ba2b-8b67a1d51648 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:03.034574 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-49429b6c-b57f-4e64-ba2b-8b67a1d51648 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:03.144813 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-612264c1-a73a-4a04-9006-0d21e2609eb1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:03.145517 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-612264c1-a73a-4a04-9006-0d21e2609eb1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:03.152503 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-612264c1-a73a-4a04-9006-0d21e2609eb1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:03.152952 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-612264c1-a73a-4a04-9006-0d21e2609eb1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:03.153735 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-612264c1-a73a-4a04-9006-0d21e2609eb1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:03.154179 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-612264c1-a73a-4a04-9006-0d21e2609eb1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:03.170866 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-49429b6c-b57f-4e64-ba2b-8b67a1d51648 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:03.179504 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-49429b6c-b57f-4e64-ba2b-8b67a1d51648 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:03.181173 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-49429b6c-b57f-4e64-ba2b-8b67a1d51648 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:03.182337 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-49429b6c-b57f-4e64-ba2b-8b67a1d51648 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1721 microversion: 2.20 time: 0.160762 Jun 30 16:37:03.182894 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 193/393] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:03 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:03.292955 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-612264c1-a73a-4a04-9006-0d21e2609eb1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:03.300742 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-612264c1-a73a-4a04-9006-0d21e2609eb1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.159743 Jun 30 16:37:03.301301 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 201/394] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:03 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:04.201062 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1aea2af1-1fff-4bd3-9960-282686296d5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:04.201667 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1aea2af1-1fff-4bd3-9960-282686296d5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:04.208301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1aea2af1-1fff-4bd3-9960-282686296d5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:04.208746 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1aea2af1-1fff-4bd3-9960-282686296d5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:04.209504 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1aea2af1-1fff-4bd3-9960-282686296d5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:04.209940 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1aea2af1-1fff-4bd3-9960-282686296d5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:04.326994 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-357d6a36-a200-4817-8782-e39a4f5b45a3 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:04.327715 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-357d6a36-a200-4817-8782-e39a4f5b45a3 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:04.334101 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-357d6a36-a200-4817-8782-e39a4f5b45a3 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:04.334555 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-357d6a36-a200-4817-8782-e39a4f5b45a3 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:04.335901 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-357d6a36-a200-4817-8782-e39a4f5b45a3 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:04.336513 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-357d6a36-a200-4817-8782-e39a4f5b45a3 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:04.345738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1aea2af1-1fff-4bd3-9960-282686296d5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:04.355057 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1aea2af1-1fff-4bd3-9960-282686296d5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:04.356596 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1aea2af1-1fff-4bd3-9960-282686296d5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:04.357746 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1aea2af1-1fff-4bd3-9960-282686296d5a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1721 microversion: 2.20 time: 0.160661 Jun 30 16:37:04.358506 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 194/395] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:04 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:04.469224 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-357d6a36-a200-4817-8782-e39a4f5b45a3 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:04.478263 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-357d6a36-a200-4817-8782-e39a4f5b45a3 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.155003 Jun 30 16:37:04.478830 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 202/396] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:04 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:05.376106 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-cdf1da84-ddf9-4391-ba99-56cbcbc4a544 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:05.376716 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-cdf1da84-ddf9-4391-ba99-56cbcbc4a544 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:05.384012 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cdf1da84-ddf9-4391-ba99-56cbcbc4a544 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:05.384727 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cdf1da84-ddf9-4391-ba99-56cbcbc4a544 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:05.385504 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cdf1da84-ddf9-4391-ba99-56cbcbc4a544 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:05.385969 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cdf1da84-ddf9-4391-ba99-56cbcbc4a544 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:05.496144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-668c1388-0879-4472-b158-f33b21e35d0c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:05.496760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-668c1388-0879-4472-b158-f33b21e35d0c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:05.509744 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-668c1388-0879-4472-b158-f33b21e35d0c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:05.510689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-668c1388-0879-4472-b158-f33b21e35d0c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:05.511962 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-668c1388-0879-4472-b158-f33b21e35d0c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:05.512410 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-668c1388-0879-4472-b158-f33b21e35d0c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:05.541951 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-cdf1da84-ddf9-4391-ba99-56cbcbc4a544 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:05.545318 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=100 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:05.552839 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-cdf1da84-ddf9-4391-ba99-56cbcbc4a544 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:05.554912 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-cdf1da84-ddf9-4391-ba99-56cbcbc4a544 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:05.556350 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-cdf1da84-ddf9-4391-ba99-56cbcbc4a544 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1724 microversion: 2.20 time: 0.184224 Jun 30 16:37:05.556921 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 195/397] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:05 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:05.575020 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f4b667ec-dc1d-43e6-b936-0e58b63ecce8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89e81406-5b4b-4ae8-a0c7-3ea85c0a4fc5"}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:05.576160 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f4b667ec-dc1d-43e6-b936-0e58b63ecce8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:05.582545 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f4b667ec-dc1d-43e6-b936-0e58b63ecce8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:05.583000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f4b667ec-dc1d-43e6-b936-0e58b63ecce8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:05.583814 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f4b667ec-dc1d-43e6-b936-0e58b63ecce8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:05.584261 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f4b667ec-dc1d-43e6-b936-0e58b63ecce8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:05.666786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-668c1388-0879-4472-b158-f33b21e35d0c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:05.674695 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-668c1388-0879-4472-b158-f33b21e35d0c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.184451 Jun 30 16:37:05.675257 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 203/398] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:05 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:06.691192 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-02484b39-d2e4-4e34-904c-302972f90620 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:06.691882 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-02484b39-d2e4-4e34-904c-302972f90620 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:06.699139 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-02484b39-d2e4-4e34-904c-302972f90620 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:06.699625 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-02484b39-d2e4-4e34-904c-302972f90620 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:06.700420 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-02484b39-d2e4-4e34-904c-302972f90620 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:06.700831 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-02484b39-d2e4-4e34-904c-302972f90620 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:06.786332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f4b667ec-dc1d-43e6-b936-0e58b63ecce8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "POST /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.215314 Jun 30 16:37:06.786934 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 196/399] 10.222.0.67 () {62 vars in 1363 bytes} [Thu Jun 30 16:37:05 2022] POST /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/os-volume_attachments => generated 188 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:37:06.843723 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-02484b39-d2e4-4e34-904c-302972f90620 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:06.849185 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-02484b39-d2e4-4e34-904c-302972f90620 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.161783 Jun 30 16:37:06.849753 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 204/400] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:06 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:06.907879 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-907241e5-0bb8-4374-9140-8e5ffad71356 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:06.908284 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-907241e5-0bb8-4374-9140-8e5ffad71356 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:06.916054 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-907241e5-0bb8-4374-9140-8e5ffad71356 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:06.916541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-907241e5-0bb8-4374-9140-8e5ffad71356 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:06.917329 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-907241e5-0bb8-4374-9140-8e5ffad71356 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:06.917774 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-907241e5-0bb8-4374-9140-8e5ffad71356 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:07.187355 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-907241e5-0bb8-4374-9140-8e5ffad71356 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "POST /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/action" status: 202 len: 0 microversion: 2.20 time: 0.283489 Jun 30 16:37:07.187919 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 197/401] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Jun 30 16:37:06 2022] POST /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:37:07.196078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a5fb6cf5-5cbb-45b5-b500-a54d3a3e88b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:07.196683 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a5fb6cf5-5cbb-45b5-b500-a54d3a3e88b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:07.202961 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a5fb6cf5-5cbb-45b5-b500-a54d3a3e88b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:07.203415 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a5fb6cf5-5cbb-45b5-b500-a54d3a3e88b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:07.204258 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a5fb6cf5-5cbb-45b5-b500-a54d3a3e88b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:07.204918 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a5fb6cf5-5cbb-45b5-b500-a54d3a3e88b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:07.339954 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a5fb6cf5-5cbb-45b5-b500-a54d3a3e88b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:07.348577 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a5fb6cf5-5cbb-45b5-b500-a54d3a3e88b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:07.350084 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a5fb6cf5-5cbb-45b5-b500-a54d3a3e88b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:07.351983 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a5fb6cf5-5cbb-45b5-b500-a54d3a3e88b2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1810 microversion: 2.20 time: 0.159068 Jun 30 16:37:07.352594 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 205/402] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:07 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:37:07.866732 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d37487f0-fa1d-44f1-82f2-4b65e28f6760 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:07.867355 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d37487f0-fa1d-44f1-82f2-4b65e28f6760 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:07.873905 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d37487f0-fa1d-44f1-82f2-4b65e28f6760 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:07.874368 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d37487f0-fa1d-44f1-82f2-4b65e28f6760 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:07.875142 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d37487f0-fa1d-44f1-82f2-4b65e28f6760 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:07.875610 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d37487f0-fa1d-44f1-82f2-4b65e28f6760 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:08.022872 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d37487f0-fa1d-44f1-82f2-4b65e28f6760 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:08.030547 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d37487f0-fa1d-44f1-82f2-4b65e28f6760 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.168201 Jun 30 16:37:08.031111 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 198/403] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:07 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:08.370778 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4bc016dc-4fe9-4b55-9fad-8441d9199477 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:08.371391 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4bc016dc-4fe9-4b55-9fad-8441d9199477 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:08.377955 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4bc016dc-4fe9-4b55-9fad-8441d9199477 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:08.378402 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4bc016dc-4fe9-4b55-9fad-8441d9199477 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:08.379198 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4bc016dc-4fe9-4b55-9fad-8441d9199477 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:08.379665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4bc016dc-4fe9-4b55-9fad-8441d9199477 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:08.521751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4bc016dc-4fe9-4b55-9fad-8441d9199477 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:08.528406 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4bc016dc-4fe9-4b55-9fad-8441d9199477 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:08.529918 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4bc016dc-4fe9-4b55-9fad-8441d9199477 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:08.531085 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-4bc016dc-4fe9-4b55-9fad-8441d9199477 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1810 microversion: 2.20 time: 0.164926 Jun 30 16:37:08.531658 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 206/404] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:08 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:09.047932 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-81ce5053-789c-4dd0-8602-0975427e0ca1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:09.048541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-81ce5053-789c-4dd0-8602-0975427e0ca1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:09.055772 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-81ce5053-789c-4dd0-8602-0975427e0ca1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:09.056227 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-81ce5053-789c-4dd0-8602-0975427e0ca1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:09.056989 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-81ce5053-789c-4dd0-8602-0975427e0ca1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:09.057419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-81ce5053-789c-4dd0-8602-0975427e0ca1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:09.193257 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-81ce5053-789c-4dd0-8602-0975427e0ca1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:09.201966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-81ce5053-789c-4dd0-8602-0975427e0ca1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.158282 Jun 30 16:37:09.202575 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 199/405] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:09 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:09.550409 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-42720674-15d6-4f48-ba6f-56e2ab268fc2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:09.551003 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-42720674-15d6-4f48-ba6f-56e2ab268fc2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:09.558786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-42720674-15d6-4f48-ba6f-56e2ab268fc2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:09.559232 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-42720674-15d6-4f48-ba6f-56e2ab268fc2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:09.560051 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-42720674-15d6-4f48-ba6f-56e2ab268fc2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:09.560487 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-42720674-15d6-4f48-ba6f-56e2ab268fc2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:09.708818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-42720674-15d6-4f48-ba6f-56e2ab268fc2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:09.719140 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-42720674-15d6-4f48-ba6f-56e2ab268fc2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:09.721005 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-42720674-15d6-4f48-ba6f-56e2ab268fc2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:09.723842 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-42720674-15d6-4f48-ba6f-56e2ab268fc2 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1810 microversion: 2.20 time: 0.177566 Jun 30 16:37:09.724583 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 207/406] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:09 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:10.219748 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-dd6b3213-b5af-47b2-adc9-1ca40be9348f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:10.220487 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-dd6b3213-b5af-47b2-adc9-1ca40be9348f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:10.228251 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dd6b3213-b5af-47b2-adc9-1ca40be9348f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:10.229069 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dd6b3213-b5af-47b2-adc9-1ca40be9348f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:10.229857 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dd6b3213-b5af-47b2-adc9-1ca40be9348f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:10.230571 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dd6b3213-b5af-47b2-adc9-1ca40be9348f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:10.372597 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-dd6b3213-b5af-47b2-adc9-1ca40be9348f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:10.381154 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-dd6b3213-b5af-47b2-adc9-1ca40be9348f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.164983 Jun 30 16:37:10.381858 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 200/407] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:10 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:10.742781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-eaab5603-3b08-4b4e-9ab4-ac4c2fcaf388 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:10.743410 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-eaab5603-3b08-4b4e-9ab4-ac4c2fcaf388 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:10.750296 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eaab5603-3b08-4b4e-9ab4-ac4c2fcaf388 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:10.750749 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eaab5603-3b08-4b4e-9ab4-ac4c2fcaf388 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:10.751544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eaab5603-3b08-4b4e-9ab4-ac4c2fcaf388 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:10.752069 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eaab5603-3b08-4b4e-9ab4-ac4c2fcaf388 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:10.901611 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-eaab5603-3b08-4b4e-9ab4-ac4c2fcaf388 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:10.909951 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-eaab5603-3b08-4b4e-9ab4-ac4c2fcaf388 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:10.911451 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-eaab5603-3b08-4b4e-9ab4-ac4c2fcaf388 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:10.912682 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-eaab5603-3b08-4b4e-9ab4-ac4c2fcaf388 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1752 microversion: 2.20 time: 0.173892 Jun 30 16:37:10.913256 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 208/408] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:10 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:11.400040 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4c976e21-ea4a-424b-b990-9be63387a8b0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:11.400656 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4c976e21-ea4a-424b-b990-9be63387a8b0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:11.407375 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4c976e21-ea4a-424b-b990-9be63387a8b0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:11.407908 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4c976e21-ea4a-424b-b990-9be63387a8b0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:11.409364 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4c976e21-ea4a-424b-b990-9be63387a8b0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:11.409364 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4c976e21-ea4a-424b-b990-9be63387a8b0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:11.551009 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-4c976e21-ea4a-424b-b990-9be63387a8b0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:11.559029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-4c976e21-ea4a-424b-b990-9be63387a8b0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.164381 Jun 30 16:37:11.559622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 201/409] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:11 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:11.932088 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4c608393-b118-4721-88ae-007f6d664f33 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:11.932727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4c608393-b118-4721-88ae-007f6d664f33 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:11.939171 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4c608393-b118-4721-88ae-007f6d664f33 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:11.939659 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4c608393-b118-4721-88ae-007f6d664f33 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:11.940430 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4c608393-b118-4721-88ae-007f6d664f33 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:11.940874 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4c608393-b118-4721-88ae-007f6d664f33 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:12.081588 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4c608393-b118-4721-88ae-007f6d664f33 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:12.090705 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4c608393-b118-4721-88ae-007f6d664f33 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:12.092219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4c608393-b118-4721-88ae-007f6d664f33 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:12.093361 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-4c608393-b118-4721-88ae-007f6d664f33 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.166028 Jun 30 16:37:12.093911 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 209/410] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:11 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:12.277856 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-c7cc9610-ad66-4220-8e0f-404160e69bde req-61b45f9a-3e10-4dfb-aab5-aa9babe3eebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "857e209a-1b96-4de8-aae0-f4b0091275c7", "name": "network-vif-plugged", "status": "completed", "tag": "2cd6c343-43aa-4c82-90b3-e348a6daf264"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:12.298305 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-c7cc9610-ad66-4220-8e0f-404160e69bde req-61b45f9a-3e10-4dfb-aab5-aa9babe3eebd service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:12.298790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-c7cc9610-ad66-4220-8e0f-404160e69bde req-61b45f9a-3e10-4dfb-aab5-aa9babe3eebd service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:12.317536 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-c7cc9610-ad66-4220-8e0f-404160e69bde req-61b45f9a-3e10-4dfb-aab5-aa9babe3eebd service nova] Creating event network-vif-plugged:2cd6c343-43aa-4c82-90b3-e348a6daf264 for instance 857e209a-1b96-4de8-aae0-f4b0091275c7 on hv-cinder-83602 Jun 30 16:37:12.322601 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-c7cc9610-ad66-4220-8e0f-404160e69bde req-61b45f9a-3e10-4dfb-aab5-aa9babe3eebd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049450 Jun 30 16:37:12.323262 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 202/411] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:37:12.579738 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-fda442f6-3889-4e38-af2c-765b31ebd81d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:12.579738 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-fda442f6-3889-4e38-af2c-765b31ebd81d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:12.584565 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fda442f6-3889-4e38-af2c-765b31ebd81d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:12.585026 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fda442f6-3889-4e38-af2c-765b31ebd81d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:12.587629 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fda442f6-3889-4e38-af2c-765b31ebd81d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:12.588219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fda442f6-3889-4e38-af2c-765b31ebd81d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:12.749422 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-fda442f6-3889-4e38-af2c-765b31ebd81d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:12.761171 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-fda442f6-3889-4e38-af2c-765b31ebd81d tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.188144 Jun 30 16:37:12.762314 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 210/412] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:12 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:13.113048 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-98d2de84-84ec-40b3-b1d2-4c7dfdaa86de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:13.113745 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-98d2de84-84ec-40b3-b1d2-4c7dfdaa86de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:13.120672 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-98d2de84-84ec-40b3-b1d2-4c7dfdaa86de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:13.121117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-98d2de84-84ec-40b3-b1d2-4c7dfdaa86de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:13.121938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-98d2de84-84ec-40b3-b1d2-4c7dfdaa86de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:13.122373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-98d2de84-84ec-40b3-b1d2-4c7dfdaa86de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:13.276858 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-98d2de84-84ec-40b3-b1d2-4c7dfdaa86de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:13.285786 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-98d2de84-84ec-40b3-b1d2-4c7dfdaa86de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:13.287304 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-98d2de84-84ec-40b3-b1d2-4c7dfdaa86de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:13.292418 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-98d2de84-84ec-40b3-b1d2-4c7dfdaa86de tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.180252 Jun 30 16:37:13.292418 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 203/413] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:13 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:13.593610 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5d030308-a964-41ff-96d4-32bd23fefbeb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:13.597572 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5d030308-a964-41ff-96d4-32bd23fefbeb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:13.606607 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5d030308-a964-41ff-96d4-32bd23fefbeb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:13.611786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5d030308-a964-41ff-96d4-32bd23fefbeb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:13.611786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5d030308-a964-41ff-96d4-32bd23fefbeb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:13.611786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5d030308-a964-41ff-96d4-32bd23fefbeb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:13.641751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=100 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:13.738537 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-5d030308-a964-41ff-96d4-32bd23fefbeb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lazy-loading 'services' on Instance uuid cc03842b-e56f-4828-99c9-0b175cd2277f {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:37:13.779202 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7431b0ea-742d-411e-8dd8-65888d93afa1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:13.779966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-7431b0ea-742d-411e-8dd8-65888d93afa1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:13.786027 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7431b0ea-742d-411e-8dd8-65888d93afa1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:13.786485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7431b0ea-742d-411e-8dd8-65888d93afa1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:13.787259 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7431b0ea-742d-411e-8dd8-65888d93afa1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:13.787736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7431b0ea-742d-411e-8dd8-65888d93afa1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:13.924547 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-7431b0ea-742d-411e-8dd8-65888d93afa1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:13.932794 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7431b0ea-742d-411e-8dd8-65888d93afa1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.157337 Jun 30 16:37:13.933368 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 204/414] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:13 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:14.037997 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5d030308-a964-41ff-96d4-32bd23fefbeb tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f/os-volume_attachments/57cc5c63-bb7a-4829-926c-65930dfc71b2" status: 202 len: 0 microversion: 2.1 time: 0.448818 Jun 30 16:37:14.038593 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 211/415] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 30 16:37:13 2022] DELETE /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f/os-volume_attachments/57cc5c63-bb7a-4829-926c-65930dfc71b2 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:37:14.309384 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-642eeaf0-467d-474c-82f7-70f3bb1a0d78 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:14.310035 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-642eeaf0-467d-474c-82f7-70f3bb1a0d78 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:14.316721 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-642eeaf0-467d-474c-82f7-70f3bb1a0d78 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:14.317174 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-642eeaf0-467d-474c-82f7-70f3bb1a0d78 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:14.317942 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-642eeaf0-467d-474c-82f7-70f3bb1a0d78 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:14.318420 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-642eeaf0-467d-474c-82f7-70f3bb1a0d78 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:14.473720 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-642eeaf0-467d-474c-82f7-70f3bb1a0d78 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:14.483180 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-642eeaf0-467d-474c-82f7-70f3bb1a0d78 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:14.487788 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-642eeaf0-467d-474c-82f7-70f3bb1a0d78 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:14.489001 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-642eeaf0-467d-474c-82f7-70f3bb1a0d78 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.183636 Jun 30 16:37:14.489571 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 205/416] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:14 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:14.952931 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-10e3436b-08fb-4ff8-bf5f-f4651e124fdc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:14.953672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-10e3436b-08fb-4ff8-bf5f-f4651e124fdc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:14.960987 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10e3436b-08fb-4ff8-bf5f-f4651e124fdc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:14.961729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10e3436b-08fb-4ff8-bf5f-f4651e124fdc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:14.962701 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10e3436b-08fb-4ff8-bf5f-f4651e124fdc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:14.963288 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10e3436b-08fb-4ff8-bf5f-f4651e124fdc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:15.163776 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-10e3436b-08fb-4ff8-bf5f-f4651e124fdc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:15.172564 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-10e3436b-08fb-4ff8-bf5f-f4651e124fdc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1315 microversion: 2.1 time: 0.225869 Jun 30 16:37:15.173489 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 212/417] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:14 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:15.507354 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e33880f8-9359-4f4a-b9f1-f4ea0edc66d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:15.507988 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e33880f8-9359-4f4a-b9f1-f4ea0edc66d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:15.515388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e33880f8-9359-4f4a-b9f1-f4ea0edc66d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:15.515918 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e33880f8-9359-4f4a-b9f1-f4ea0edc66d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:15.516687 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e33880f8-9359-4f4a-b9f1-f4ea0edc66d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:15.517123 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e33880f8-9359-4f4a-b9f1-f4ea0edc66d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:15.581161 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:37:15.581387 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Thu Jun 30 16:37:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 (ip 10.222.0.67) !!! Jun 30 16:37:15.735527 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e33880f8-9359-4f4a-b9f1-f4ea0edc66d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:15.747862 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e33880f8-9359-4f4a-b9f1-f4ea0edc66d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:15.767820 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e33880f8-9359-4f4a-b9f1-f4ea0edc66d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:15.767820 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e33880f8-9359-4f4a-b9f1-f4ea0edc66d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.262357 Jun 30 16:37:15.768548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 206/418] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:15 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:16.190322 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8f1563f1-f37f-4d77-a43b-07f2c19ed9bc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:16.191014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8f1563f1-f37f-4d77-a43b-07f2c19ed9bc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:16.199026 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8f1563f1-f37f-4d77-a43b-07f2c19ed9bc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:16.199559 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8f1563f1-f37f-4d77-a43b-07f2c19ed9bc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:16.200282 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8f1563f1-f37f-4d77-a43b-07f2c19ed9bc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:16.200714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8f1563f1-f37f-4d77-a43b-07f2c19ed9bc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:16.407846 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8f1563f1-f37f-4d77-a43b-07f2c19ed9bc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:16.417076 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8f1563f1-f37f-4d77-a43b-07f2c19ed9bc tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1465 microversion: 2.1 time: 0.230494 Jun 30 16:37:16.429603 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 213/419] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:16 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1465 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:16.461149 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d1668054-d734-4cd6-8a9e-17a1858b4a50 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:16.461657 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d1668054-d734-4cd6-8a9e-17a1858b4a50 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:16.473636 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d1668054-d734-4cd6-8a9e-17a1858b4a50 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:16.474535 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d1668054-d734-4cd6-8a9e-17a1858b4a50 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:16.475552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d1668054-d734-4cd6-8a9e-17a1858b4a50 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:16.476137 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d1668054-d734-4cd6-8a9e-17a1858b4a50 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:16.504318 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d1668054-d734-4cd6-8a9e-17a1858b4a50 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Going to try to terminate instance {{(pid=124815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:37:16.696515 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:16.798822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-b1a3354c-f389-4ca3-8be1-982919165e4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:16.800248 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-b1a3354c-f389-4ca3-8be1-982919165e4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:16.834858 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b1a3354c-f389-4ca3-8be1-982919165e4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:16.835731 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b1a3354c-f389-4ca3-8be1-982919165e4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:16.836602 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b1a3354c-f389-4ca3-8be1-982919165e4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:16.840799 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b1a3354c-f389-4ca3-8be1-982919165e4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:16.922194 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d1668054-d734-4cd6-8a9e-17a1858b4a50 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "DELETE /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 204 len: 0 microversion: 2.1 time: 0.461539 Jun 30 16:37:16.925984 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 207/420] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:37:16 2022] DELETE /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:37:16.934209 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a1b4ebe4-6c17-4654-b345-cfbb9353c75f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:16.935339 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a1b4ebe4-6c17-4654-b345-cfbb9353c75f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:16.955218 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a1b4ebe4-6c17-4654-b345-cfbb9353c75f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:16.955746 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a1b4ebe4-6c17-4654-b345-cfbb9353c75f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:16.957398 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a1b4ebe4-6c17-4654-b345-cfbb9353c75f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:16.957879 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a1b4ebe4-6c17-4654-b345-cfbb9353c75f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:17.080534 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b1a3354c-f389-4ca3-8be1-982919165e4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:17.089818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b1a3354c-f389-4ca3-8be1-982919165e4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:17.091411 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b1a3354c-f389-4ca3-8be1-982919165e4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:17.092649 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-b1a3354c-f389-4ca3-8be1-982919165e4d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.307684 Jun 30 16:37:17.093209 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 214/421] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:16 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:17.133426 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a1b4ebe4-6c17-4654-b345-cfbb9353c75f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:17.147648 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a1b4ebe4-6c17-4654-b345-cfbb9353c75f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1471 microversion: 2.1 time: 0.219859 Jun 30 16:37:17.148236 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 208/422] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:16 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1471 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:18.111779 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9ff6847d-c6db-4f9d-ac8d-17382f76f914 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:18.112423 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9ff6847d-c6db-4f9d-ac8d-17382f76f914 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:18.120840 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9ff6847d-c6db-4f9d-ac8d-17382f76f914 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:18.121305 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9ff6847d-c6db-4f9d-ac8d-17382f76f914 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:18.122097 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9ff6847d-c6db-4f9d-ac8d-17382f76f914 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:18.122542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9ff6847d-c6db-4f9d-ac8d-17382f76f914 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:18.164760 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7cb31f93-9f4c-43ac-be46-24b971e91c6f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:18.166712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-7cb31f93-9f4c-43ac-be46-24b971e91c6f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:18.178862 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7cb31f93-9f4c-43ac-be46-24b971e91c6f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:18.179324 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7cb31f93-9f4c-43ac-be46-24b971e91c6f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:18.180174 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7cb31f93-9f4c-43ac-be46-24b971e91c6f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:18.180604 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7cb31f93-9f4c-43ac-be46-24b971e91c6f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:18.404309 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9ff6847d-c6db-4f9d-ac8d-17382f76f914 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:18.407948 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-7cb31f93-9f4c-43ac-be46-24b971e91c6f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:18.414884 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9ff6847d-c6db-4f9d-ac8d-17382f76f914 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:18.417005 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7cb31f93-9f4c-43ac-be46-24b971e91c6f tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1471 microversion: 2.1 time: 0.256042 Jun 30 16:37:18.417573 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9ff6847d-c6db-4f9d-ac8d-17382f76f914 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:18.417728 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 209/423] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:18 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1471 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:18.419290 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9ff6847d-c6db-4f9d-ac8d-17382f76f914 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.311525 Jun 30 16:37:18.421837 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 215/424] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:18 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:18.998439 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1908045368", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1708708675", "security_groups": [{"name": "tempest-secgroup-smoke-965275676"}], "networks": [{"uuid": "43d53998-b324-428d-a316-199f927750c3"}], "block_device_mapping_v2": [{"uuid": "1ca77126-3ed3-4881-a540-bcd433bf5adf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:19.156998 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.network.neutron [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] validate_networks() for [('43d53998-b324-428d-a316-199f927750c3', None, None, None, None, None)] {{(pid=124815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:37:19.445510 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-670696ed-8d63-4b9e-9d4d-56a8e867ea1a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:19.448443 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-670696ed-8d63-4b9e-9d4d-56a8e867ea1a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:19.455957 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-670696ed-8d63-4b9e-9d4d-56a8e867ea1a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:19.460073 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-670696ed-8d63-4b9e-9d4d-56a8e867ea1a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:19.460073 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-670696ed-8d63-4b9e-9d4d-56a8e867ea1a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:19.460073 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-670696ed-8d63-4b9e-9d4d-56a8e867ea1a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:19.690423 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Flavor limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:37:19.691393 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Image limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:37:19.691393 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Flavor pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:37:19.691862 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Image pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:37:19.692485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:37:19.718566 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:19.719108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:19.720040 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:19.720558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:19.739600 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Getting quotas for project 19b35fc495a345898167db62b9b95887. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:37:19.744609 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Getting quotas for user b1a5d200007a4474a2a25d2ae0915c14 and project 19b35fc495a345898167db62b9b95887. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:37:19.763044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-670696ed-8d63-4b9e-9d4d-56a8e867ea1a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:19.764840 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-670696ed-8d63-4b9e-9d4d-56a8e867ea1a tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1471 microversion: 2.1 time: 0.323473 Jun 30 16:37:19.775952 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 216/425] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:19 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1471 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:19.781943 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a56063d9-0470-47cf-b7f4-464e5d6b63d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:19.782540 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a56063d9-0470-47cf-b7f4-464e5d6b63d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:19.789572 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a56063d9-0470-47cf-b7f4-464e5d6b63d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:19.790028 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a56063d9-0470-47cf-b7f4-464e5d6b63d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:19.791100 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a56063d9-0470-47cf-b7f4-464e5d6b63d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:19.791556 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a56063d9-0470-47cf-b7f4-464e5d6b63d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:19.833585 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Going to run 1 instances... {{(pid=124815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:37:19.836002 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ca77126-3ed3-4881-a540-bcd433bf5adf',volume_size=None,volume_type=None)] {{(pid=124815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:37:19.999325 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a56063d9-0470-47cf-b7f4-464e5d6b63d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:20.011086 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a56063d9-0470-47cf-b7f4-464e5d6b63d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:20.012997 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a56063d9-0470-47cf-b7f4-464e5d6b63d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:20.014618 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a56063d9-0470-47cf-b7f4-464e5d6b63d8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.237138 Jun 30 16:37:20.015296 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 217/426] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:19 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:20.332629 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b6ee41ee-eb6d-4afe-9894-be6344747aeb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.339061 Jun 30 16:37:20.333278 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 210/427] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:37:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 16:37:20.344205 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-bea4d317-6a03-4791-acfa-895667e07cd0 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:20.345085 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-bea4d317-6a03-4791-acfa-895667e07cd0 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:20.414065 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-bea4d317-6a03-4791-acfa-895667e07cd0 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:20.422779 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-bea4d317-6a03-4791-acfa-895667e07cd0 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1089 microversion: 2.1 time: 0.082158 Jun 30 16:37:20.423426 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 218/428] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:20 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1089 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:20.783648 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2beadc66-8705-4623-9933-f60ba0ddfbfd tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:20.784518 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2beadc66-8705-4623-9933-f60ba0ddfbfd tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:20.791849 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2beadc66-8705-4623-9933-f60ba0ddfbfd tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:20.792300 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2beadc66-8705-4623-9933-f60ba0ddfbfd tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:20.793091 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2beadc66-8705-4623-9933-f60ba0ddfbfd tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:20.793519 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2beadc66-8705-4623-9933-f60ba0ddfbfd tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:20.978897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2beadc66-8705-4623-9933-f60ba0ddfbfd tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:20.978897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2beadc66-8705-4623-9933-f60ba0ddfbfd tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1471 microversion: 2.1 time: 0.175631 Jun 30 16:37:20.978897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 211/429] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:20 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:21.034678 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-79faea56-0966-406c-b6b2-f9d63a6bd770 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:21.035425 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-79faea56-0966-406c-b6b2-f9d63a6bd770 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:21.042333 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-79faea56-0966-406c-b6b2-f9d63a6bd770 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:21.042768 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-79faea56-0966-406c-b6b2-f9d63a6bd770 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:21.043562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-79faea56-0966-406c-b6b2-f9d63a6bd770 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:21.044002 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-79faea56-0966-406c-b6b2-f9d63a6bd770 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:21.185971 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-79faea56-0966-406c-b6b2-f9d63a6bd770 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:21.195217 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-79faea56-0966-406c-b6b2-f9d63a6bd770 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:21.198276 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-79faea56-0966-406c-b6b2-f9d63a6bd770 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:21.201353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-79faea56-0966-406c-b6b2-f9d63a6bd770 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.168904 Jun 30 16:37:21.201353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 219/430] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:21 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:21.441291 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4c295929-f68c-444d-917a-0422c059d6bd tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:21.442491 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4c295929-f68c-444d-917a-0422c059d6bd tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:21.516977 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-4c295929-f68c-444d-917a-0422c059d6bd tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:21.527706 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-4c295929-f68c-444d-917a-0422c059d6bd tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1089 microversion: 2.1 time: 0.090249 Jun 30 16:37:21.531964 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 212/431] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:21 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1089 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:21.981795 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0295033c-86a5-4801-a35a-88b3dafdaa43 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:21.982326 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0295033c-86a5-4801-a35a-88b3dafdaa43 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:21.984392 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:21.989888 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0295033c-86a5-4801-a35a-88b3dafdaa43 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:21.990338 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0295033c-86a5-4801-a35a-88b3dafdaa43 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:21.991595 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0295033c-86a5-4801-a35a-88b3dafdaa43 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:21.992040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0295033c-86a5-4801-a35a-88b3dafdaa43 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:22.159879 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0295033c-86a5-4801-a35a-88b3dafdaa43 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:22.171029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0295033c-86a5-4801-a35a-88b3dafdaa43 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1471 microversion: 2.1 time: 0.194402 Jun 30 16:37:22.171905 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 220/432] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:21 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1471 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:22.222297 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b5130f85-b6b4-42cd-8c36-d67337de857e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:22.222999 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b5130f85-b6b4-42cd-8c36-d67337de857e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:22.243500 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b5130f85-b6b4-42cd-8c36-d67337de857e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:22.243500 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b5130f85-b6b4-42cd-8c36-d67337de857e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:22.243500 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b5130f85-b6b4-42cd-8c36-d67337de857e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:22.246544 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b5130f85-b6b4-42cd-8c36-d67337de857e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:22.405141 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b5130f85-b6b4-42cd-8c36-d67337de857e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:22.417396 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b5130f85-b6b4-42cd-8c36-d67337de857e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:22.420589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b5130f85-b6b4-42cd-8c36-d67337de857e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:22.422937 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b5130f85-b6b4-42cd-8c36-d67337de857e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.204345 Jun 30 16:37:22.424059 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 213/433] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:22 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:22.552173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8c4df83a-c3d2-4877-8a23-3e42c7215f64 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:22.553790 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8c4df83a-c3d2-4877-8a23-3e42c7215f64 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:22.564999 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8c4df83a-c3d2-4877-8a23-3e42c7215f64 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:22.566086 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8c4df83a-c3d2-4877-8a23-3e42c7215f64 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:22.567695 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8c4df83a-c3d2-4877-8a23-3e42c7215f64 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:22.569116 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8c4df83a-c3d2-4877-8a23-3e42c7215f64 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:22.650940 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8c4df83a-c3d2-4877-8a23-3e42c7215f64 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:22.659710 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8c4df83a-c3d2-4877-8a23-3e42c7215f64 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1139 microversion: 2.1 time: 0.113743 Jun 30 16:37:22.660936 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 221/434] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:22 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1139 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:23.190122 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-94d9e960-d7e0-4d7e-9324-d0d455e0a000 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:23.190976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-94d9e960-d7e0-4d7e-9324-d0d455e0a000 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:23.199852 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94d9e960-d7e0-4d7e-9324-d0d455e0a000 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:23.204120 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94d9e960-d7e0-4d7e-9324-d0d455e0a000 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:23.204120 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94d9e960-d7e0-4d7e-9324-d0d455e0a000 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:23.204120 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94d9e960-d7e0-4d7e-9324-d0d455e0a000 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:23.392947 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-94d9e960-d7e0-4d7e-9324-d0d455e0a000 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:23.402234 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-94d9e960-d7e0-4d7e-9324-d0d455e0a000 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1471 microversion: 2.1 time: 0.216557 Jun 30 16:37:23.402876 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 214/435] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:23 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1471 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:23.442482 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9d38ef02-6bcc-4578-b361-7174e8b565db tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:23.443966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9d38ef02-6bcc-4578-b361-7174e8b565db tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:23.452109 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9d38ef02-6bcc-4578-b361-7174e8b565db tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:23.452831 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9d38ef02-6bcc-4578-b361-7174e8b565db tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:23.454085 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9d38ef02-6bcc-4578-b361-7174e8b565db tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:23.454692 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9d38ef02-6bcc-4578-b361-7174e8b565db tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:23.626950 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9d38ef02-6bcc-4578-b361-7174e8b565db tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:23.637439 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9d38ef02-6bcc-4578-b361-7174e8b565db tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:23.639114 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9d38ef02-6bcc-4578-b361-7174e8b565db tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:23.640945 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9d38ef02-6bcc-4578-b361-7174e8b565db tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.202975 Jun 30 16:37:23.642140 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 222/436] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:23 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:37:23.678231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-da528b72-efbd-4a1f-b87c-244dcacebb68 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:23.679129 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-da528b72-efbd-4a1f-b87c-244dcacebb68 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:23.685774 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-da528b72-efbd-4a1f-b87c-244dcacebb68 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:23.686223 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-da528b72-efbd-4a1f-b87c-244dcacebb68 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:23.687087 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-da528b72-efbd-4a1f-b87c-244dcacebb68 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:23.687558 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-da528b72-efbd-4a1f-b87c-244dcacebb68 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:23.766277 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-da528b72-efbd-4a1f-b87c-244dcacebb68 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:23.775044 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-da528b72-efbd-4a1f-b87c-244dcacebb68 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1139 microversion: 2.1 time: 0.100405 Jun 30 16:37:23.782156 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 215/437] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:23 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1139 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:24.421179 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-eccd5228-26ae-4ad2-a411-27b6a2ab48d0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:24.422058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-eccd5228-26ae-4ad2-a411-27b6a2ab48d0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:24.428641 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eccd5228-26ae-4ad2-a411-27b6a2ab48d0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:24.429338 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eccd5228-26ae-4ad2-a411-27b6a2ab48d0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:24.430305 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eccd5228-26ae-4ad2-a411-27b6a2ab48d0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:24.430933 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eccd5228-26ae-4ad2-a411-27b6a2ab48d0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:24.662134 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a27b2b4b-3335-471c-b9fc-8292ee0af3a0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:24.662935 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a27b2b4b-3335-471c-b9fc-8292ee0af3a0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:24.677684 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a27b2b4b-3335-471c-b9fc-8292ee0af3a0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:24.680128 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a27b2b4b-3335-471c-b9fc-8292ee0af3a0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:24.682346 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a27b2b4b-3335-471c-b9fc-8292ee0af3a0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:24.683461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a27b2b4b-3335-471c-b9fc-8292ee0af3a0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:24.987643 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-eccd5228-26ae-4ad2-a411-27b6a2ab48d0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:25.002352 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-eccd5228-26ae-4ad2-a411-27b6a2ab48d0 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1471 microversion: 2.1 time: 0.585105 Jun 30 16:37:25.003663 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 223/438] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:24 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1471 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:25.016863 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0e29ab57-ec17-497f-8a90-fdd97f5f1661 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:25.017591 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0e29ab57-ec17-497f-8a90-fdd97f5f1661 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:25.030193 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0e29ab57-ec17-497f-8a90-fdd97f5f1661 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:25.030974 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0e29ab57-ec17-497f-8a90-fdd97f5f1661 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:25.032531 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0e29ab57-ec17-497f-8a90-fdd97f5f1661 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:25.033145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0e29ab57-ec17-497f-8a90-fdd97f5f1661 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:25.077943 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a27b2b4b-3335-471c-b9fc-8292ee0af3a0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:25.087271 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a27b2b4b-3335-471c-b9fc-8292ee0af3a0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:25.088914 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a27b2b4b-3335-471c-b9fc-8292ee0af3a0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:25.090110 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a27b2b4b-3335-471c-b9fc-8292ee0af3a0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.434150 Jun 30 16:37:25.091518 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 216/439] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:24 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:25.111784 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0e29ab57-ec17-497f-8a90-fdd97f5f1661 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:25.120655 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0e29ab57-ec17-497f-8a90-fdd97f5f1661 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1139 microversion: 2.1 time: 0.114253 Jun 30 16:37:25.121801 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 224/440] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:25 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1139 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:26.025081 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-fb5ffeaa-3586-4b0b-85fe-dd99d9e6a0f1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:26.026741 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-fb5ffeaa-3586-4b0b-85fe-dd99d9e6a0f1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:26.033132 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:26.035645 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fb5ffeaa-3586-4b0b-85fe-dd99d9e6a0f1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:26.036502 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fb5ffeaa-3586-4b0b-85fe-dd99d9e6a0f1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:26.037639 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fb5ffeaa-3586-4b0b-85fe-dd99d9e6a0f1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:26.038085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fb5ffeaa-3586-4b0b-85fe-dd99d9e6a0f1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:26.116403 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-dd462b83-c690-4981-9a09-36b30356f889 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:26.118028 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-dd462b83-c690-4981-9a09-36b30356f889 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:26.128015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dd462b83-c690-4981-9a09-36b30356f889 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:26.128465 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dd462b83-c690-4981-9a09-36b30356f889 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:26.129251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dd462b83-c690-4981-9a09-36b30356f889 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:26.129886 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dd462b83-c690-4981-9a09-36b30356f889 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:26.209271 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-fb5ffeaa-3586-4b0b-85fe-dd99d9e6a0f1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:26.218630 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-fb5ffeaa-3586-4b0b-85fe-dd99d9e6a0f1 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1471 microversion: 2.1 time: 0.201373 Jun 30 16:37:26.219580 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 217/441] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:26 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1471 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:26.224260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-87137072-a87f-4bf6-8924-894f9106af99 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:26.225099 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-87137072-a87f-4bf6-8924-894f9106af99 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:26.241608 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-87137072-a87f-4bf6-8924-894f9106af99 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:26.242437 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-87137072-a87f-4bf6-8924-894f9106af99 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:26.243576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-87137072-a87f-4bf6-8924-894f9106af99 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:26.244790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-87137072-a87f-4bf6-8924-894f9106af99 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:26.341528 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-87137072-a87f-4bf6-8924-894f9106af99 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:26.349257 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-87137072-a87f-4bf6-8924-894f9106af99 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1139 microversion: 2.1 time: 0.128569 Jun 30 16:37:26.351765 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 218/442] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:26 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1139 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:26.364248 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-dd462b83-c690-4981-9a09-36b30356f889 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:26.374708 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-dd462b83-c690-4981-9a09-36b30356f889 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:26.383130 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-dd462b83-c690-4981-9a09-36b30356f889 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:26.391722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-dd462b83-c690-4981-9a09-36b30356f889 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.278295 Jun 30 16:37:26.391722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 225/443] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:26 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:27.235861 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8e51402d-af58-4cf4-983f-649a21d1d419 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:27.236478 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8e51402d-af58-4cf4-983f-649a21d1d419 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:27.243640 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8e51402d-af58-4cf4-983f-649a21d1d419 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:27.244192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8e51402d-af58-4cf4-983f-649a21d1d419 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:27.245678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8e51402d-af58-4cf4-983f-649a21d1d419 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:27.246194 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8e51402d-af58-4cf4-983f-649a21d1d419 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:27.370664 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-bf800821-cc60-4e69-8fbe-4e0a07f81383 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:27.372199 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-bf800821-cc60-4e69-8fbe-4e0a07f81383 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:27.384300 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bf800821-cc60-4e69-8fbe-4e0a07f81383 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:27.386618 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bf800821-cc60-4e69-8fbe-4e0a07f81383 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:27.388903 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bf800821-cc60-4e69-8fbe-4e0a07f81383 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:27.389908 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bf800821-cc60-4e69-8fbe-4e0a07f81383 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:27.400510 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8e51402d-af58-4cf4-983f-649a21d1d419 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:27.409249 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8e51402d-af58-4cf4-983f-649a21d1d419 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1471 microversion: 2.1 time: 0.177192 Jun 30 16:37:27.410771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 219/444] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:27 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1471 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:27.415754 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f6ca9376-65a5-4ddd-9ae2-b97ee4733e0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:27.416737 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f6ca9376-65a5-4ddd-9ae2-b97ee4733e0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:27.424380 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f6ca9376-65a5-4ddd-9ae2-b97ee4733e0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:27.425176 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f6ca9376-65a5-4ddd-9ae2-b97ee4733e0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:27.426320 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f6ca9376-65a5-4ddd-9ae2-b97ee4733e0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:27.426999 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f6ca9376-65a5-4ddd-9ae2-b97ee4733e0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:27.529100 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-bf800821-cc60-4e69-8fbe-4e0a07f81383 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:27.549803 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-bf800821-cc60-4e69-8fbe-4e0a07f81383 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1139 microversion: 2.1 time: 0.185017 Jun 30 16:37:27.551539 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 226/445] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:27 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1139 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:27.637583 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f6ca9376-65a5-4ddd-9ae2-b97ee4733e0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:27.648162 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f6ca9376-65a5-4ddd-9ae2-b97ee4733e0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:27.650189 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f6ca9376-65a5-4ddd-9ae2-b97ee4733e0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:27.652624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f6ca9376-65a5-4ddd-9ae2-b97ee4733e0a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.240602 Jun 30 16:37:27.663531 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 220/446] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:27 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:28.429904 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f2d704d2-85cb-40ef-b397-67dcc4363058 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:28.431354 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f2d704d2-85cb-40ef-b397-67dcc4363058 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:28.439201 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f2d704d2-85cb-40ef-b397-67dcc4363058 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:28.439893 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f2d704d2-85cb-40ef-b397-67dcc4363058 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:28.440780 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f2d704d2-85cb-40ef-b397-67dcc4363058 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:28.441289 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f2d704d2-85cb-40ef-b397-67dcc4363058 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:28.567741 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-936e1cdb-9b01-4869-80f7-072e9e6a2261 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:28.568385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-936e1cdb-9b01-4869-80f7-072e9e6a2261 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:28.585458 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-936e1cdb-9b01-4869-80f7-072e9e6a2261 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:28.587203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-936e1cdb-9b01-4869-80f7-072e9e6a2261 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:28.588948 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-936e1cdb-9b01-4869-80f7-072e9e6a2261 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:28.589568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-936e1cdb-9b01-4869-80f7-072e9e6a2261 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:28.620216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f2d704d2-85cb-40ef-b397-67dcc4363058 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:28.629065 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f2d704d2-85cb-40ef-b397-67dcc4363058 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1471 microversion: 2.1 time: 0.204558 Jun 30 16:37:28.641077 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 227/447] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:28 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1471 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:28.675003 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-410b11b1-e224-4493-abd5-927fbd24ea0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:28.675180 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-936e1cdb-9b01-4869-80f7-072e9e6a2261 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:28.676733 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-410b11b1-e224-4493-abd5-927fbd24ea0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:28.684639 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-936e1cdb-9b01-4869-80f7-072e9e6a2261 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1131 microversion: 2.1 time: 0.120779 Jun 30 16:37:28.685934 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 221/448] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:28 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1131 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:28.686233 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-410b11b1-e224-4493-abd5-927fbd24ea0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:28.686888 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-410b11b1-e224-4493-abd5-927fbd24ea0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:28.688226 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-410b11b1-e224-4493-abd5-927fbd24ea0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:28.689054 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-410b11b1-e224-4493-abd5-927fbd24ea0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:28.718908 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:28.864514 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-410b11b1-e224-4493-abd5-927fbd24ea0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:28.875835 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-410b11b1-e224-4493-abd5-927fbd24ea0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:28.878407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-410b11b1-e224-4493-abd5-927fbd24ea0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:28.887918 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-410b11b1-e224-4493-abd5-927fbd24ea0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.210550 Jun 30 16:37:28.887918 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 228/449] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:28 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:29.647348 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-5ef77248-ec96-4a83-b716-55c7a843d885 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:29.648130 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-5ef77248-ec96-4a83-b716-55c7a843d885 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:29.656100 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5ef77248-ec96-4a83-b716-55c7a843d885 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:29.656735 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5ef77248-ec96-4a83-b716-55c7a843d885 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:29.657568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5ef77248-ec96-4a83-b716-55c7a843d885 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:29.658095 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5ef77248-ec96-4a83-b716-55c7a843d885 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:29.703846 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e1f632e9-932d-477f-a4b0-6b375faf35d2 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:29.704455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e1f632e9-932d-477f-a4b0-6b375faf35d2 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:29.711822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1f632e9-932d-477f-a4b0-6b375faf35d2 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:29.712268 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1f632e9-932d-477f-a4b0-6b375faf35d2 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:29.713186 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1f632e9-932d-477f-a4b0-6b375faf35d2 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:29.714922 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1f632e9-932d-477f-a4b0-6b375faf35d2 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:29.728712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:29.807832 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-e1f632e9-932d-477f-a4b0-6b375faf35d2 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:29.822035 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e1f632e9-932d-477f-a4b0-6b375faf35d2 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1131 microversion: 2.1 time: 0.121452 Jun 30 16:37:29.823766 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 229/450] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:29 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1131 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:29.871570 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5ef77248-ec96-4a83-b716-55c7a843d885 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:29.881539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-5ef77248-ec96-4a83-b716-55c7a843d885 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1471 microversion: 2.1 time: 0.238046 Jun 30 16:37:29.882132 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 222/451] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:29 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:29.899902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-734eee61-2644-4427-a8b6-8bc57fd32a75 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:29.901425 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-734eee61-2644-4427-a8b6-8bc57fd32a75 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:29.907863 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-734eee61-2644-4427-a8b6-8bc57fd32a75 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:29.908320 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-734eee61-2644-4427-a8b6-8bc57fd32a75 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:29.909111 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-734eee61-2644-4427-a8b6-8bc57fd32a75 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:29.909551 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-734eee61-2644-4427-a8b6-8bc57fd32a75 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:30.078650 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-734eee61-2644-4427-a8b6-8bc57fd32a75 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:30.088854 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-734eee61-2644-4427-a8b6-8bc57fd32a75 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:30.091079 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-734eee61-2644-4427-a8b6-8bc57fd32a75 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:30.092594 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-734eee61-2644-4427-a8b6-8bc57fd32a75 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.198000 Jun 30 16:37:30.093312 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 230/452] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:29 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:30.333543 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-84e234f2-4954-401c-b9fb-fca1e35df258 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:30.340178 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-84e234f2-4954-401c-b9fb-fca1e35df258 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:30.342053 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-84e234f2-4954-401c-b9fb-fca1e35df258 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:30.342691 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-84e234f2-4954-401c-b9fb-fca1e35df258 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:30.343714 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-84e234f2-4954-401c-b9fb-fca1e35df258 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:30.344334 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-84e234f2-4954-401c-b9fb-fca1e35df258 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:30.382216 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-84e234f2-4954-401c-b9fb-fca1e35df258 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Going to try to terminate instance {{(pid=124815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:37:30.813389 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-84e234f2-4954-401c-b9fb-fca1e35df258 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 204 len: 0 microversion: 2.1 time: 0.483360 Jun 30 16:37:30.818831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 223/453] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:37:30 2022] DELETE /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:37:30.823692 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9d7134ed-c696-43c6-8b33-c70d67437263 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:30.834971 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9d7134ed-c696-43c6-8b33-c70d67437263 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:30.841561 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=2 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:30.842690 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6d78a87d-22bc-4b17-9e0b-fbfa16340f04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:30.843429 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6d78a87d-22bc-4b17-9e0b-fbfa16340f04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:30.844115 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9d7134ed-c696-43c6-8b33-c70d67437263 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:30.844574 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9d7134ed-c696-43c6-8b33-c70d67437263 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:30.845569 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9d7134ed-c696-43c6-8b33-c70d67437263 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:30.846019 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9d7134ed-c696-43c6-8b33-c70d67437263 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:30.852356 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d78a87d-22bc-4b17-9e0b-fbfa16340f04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:30.855382 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d78a87d-22bc-4b17-9e0b-fbfa16340f04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:30.856774 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d78a87d-22bc-4b17-9e0b-fbfa16340f04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:30.856944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d78a87d-22bc-4b17-9e0b-fbfa16340f04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:30.911268 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:30.991854 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6d78a87d-22bc-4b17-9e0b-fbfa16340f04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:31.004392 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6d78a87d-22bc-4b17-9e0b-fbfa16340f04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1187 microversion: 2.1 time: 0.167992 Jun 30 16:37:31.015768 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 224/454] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:30 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1187 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:31.020894 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-84226d80-80f2-4804-b115-2b2d4ce5c888 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:31.021516 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-84226d80-80f2-4804-b115-2b2d4ce5c888 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:31.028494 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-84226d80-80f2-4804-b115-2b2d4ce5c888 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:31.029233 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-84226d80-80f2-4804-b115-2b2d4ce5c888 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:31.030245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-84226d80-80f2-4804-b115-2b2d4ce5c888 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:31.030860 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-84226d80-80f2-4804-b115-2b2d4ce5c888 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:31.046862 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9d7134ed-c696-43c6-8b33-c70d67437263 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:31.055845 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9d7134ed-c696-43c6-8b33-c70d67437263 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1513 microversion: 2.1 time: 0.237191 Jun 30 16:37:31.056689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 231/455] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:30 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1513 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:31.114254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2b29d914-733c-4ce3-8598-e3a82adc1437 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:31.115431 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2b29d914-733c-4ce3-8598-e3a82adc1437 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:31.134320 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2b29d914-733c-4ce3-8598-e3a82adc1437 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:31.135076 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2b29d914-733c-4ce3-8598-e3a82adc1437 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:31.139050 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2b29d914-733c-4ce3-8598-e3a82adc1437 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:31.139050 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2b29d914-733c-4ce3-8598-e3a82adc1437 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:31.146055 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-84226d80-80f2-4804-b115-2b2d4ce5c888 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:31.154559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-84226d80-80f2-4804-b115-2b2d4ce5c888 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1429 microversion: 2.1 time: 0.137590 Jun 30 16:37:31.158605 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 225/456] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:31 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1429 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:31.258065 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-498587d0-0af2-4f72-9c5a-59313378f42f req-24ad20bf-6515-4ac5-942d-a688b5646df4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "857e209a-1b96-4de8-aae0-f4b0091275c7", "name": "network-vif-deleted", "tag": "2cd6c343-43aa-4c82-90b3-e348a6daf264"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:31.271994 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-498587d0-0af2-4f72-9c5a-59313378f42f req-24ad20bf-6515-4ac5-942d-a688b5646df4 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:31.277685 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-498587d0-0af2-4f72-9c5a-59313378f42f req-24ad20bf-6515-4ac5-942d-a688b5646df4 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:31.297569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-498587d0-0af2-4f72-9c5a-59313378f42f req-24ad20bf-6515-4ac5-942d-a688b5646df4 service nova] Creating event network-vif-deleted:2cd6c343-43aa-4c82-90b3-e348a6daf264 for instance 857e209a-1b96-4de8-aae0-f4b0091275c7 on hv-cinder-83602 Jun 30 16:37:31.303625 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-498587d0-0af2-4f72-9c5a-59313378f42f req-24ad20bf-6515-4ac5-942d-a688b5646df4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050671 Jun 30 16:37:31.304794 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 226/457] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:37:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:37:31.332990 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2b29d914-733c-4ce3-8598-e3a82adc1437 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:31.343222 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2b29d914-733c-4ce3-8598-e3a82adc1437 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:31.344946 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2b29d914-733c-4ce3-8598-e3a82adc1437 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:31.346454 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2b29d914-733c-4ce3-8598-e3a82adc1437 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.238149 Jun 30 16:37:31.358090 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 232/458] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:31 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:32.023147 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-17ce0f29-dd90-4649-a244-587d6a1d0049 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:32.023890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-17ce0f29-dd90-4649-a244-587d6a1d0049 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:32.025912 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=8 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:32.032723 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-17ce0f29-dd90-4649-a244-587d6a1d0049 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:32.033536 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-17ce0f29-dd90-4649-a244-587d6a1d0049 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:32.034013 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-17ce0f29-dd90-4649-a244-587d6a1d0049 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:32.034465 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-17ce0f29-dd90-4649-a244-587d6a1d0049 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:32.079598 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-17bfa0c7-087f-4dbe-a73d-3c695fdd5433 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:32.080764 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-17bfa0c7-087f-4dbe-a73d-3c695fdd5433 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:32.094569 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-17bfa0c7-087f-4dbe-a73d-3c695fdd5433 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:32.095069 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-17bfa0c7-087f-4dbe-a73d-3c695fdd5433 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:32.095886 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-17bfa0c7-087f-4dbe-a73d-3c695fdd5433 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:32.096574 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-17bfa0c7-087f-4dbe-a73d-3c695fdd5433 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:32.116895 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-17ce0f29-dd90-4649-a244-587d6a1d0049 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:32.125358 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-17ce0f29-dd90-4649-a244-587d6a1d0049 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1195 microversion: 2.1 time: 0.106722 Jun 30 16:37:32.125951 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 227/459] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:32 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1195 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:32.174998 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a7442042-d842-40df-8f9e-08adc1a8cf3c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:32.175704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a7442042-d842-40df-8f9e-08adc1a8cf3c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:32.182430 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a7442042-d842-40df-8f9e-08adc1a8cf3c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:32.182887 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a7442042-d842-40df-8f9e-08adc1a8cf3c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:32.183712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a7442042-d842-40df-8f9e-08adc1a8cf3c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:32.184180 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a7442042-d842-40df-8f9e-08adc1a8cf3c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:32.304431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a7442042-d842-40df-8f9e-08adc1a8cf3c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:32.319895 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a7442042-d842-40df-8f9e-08adc1a8cf3c tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1429 microversion: 2.1 time: 0.147804 Jun 30 16:37:32.327718 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 228/460] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:32 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1429 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:32.334339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-17bfa0c7-087f-4dbe-a73d-3c695fdd5433 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:32.343977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-17bfa0c7-087f-4dbe-a73d-3c695fdd5433 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1513 microversion: 2.1 time: 0.273516 Jun 30 16:37:32.344609 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 233/461] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:32 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1513 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:32.366733 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-959794a7-aa1c-44a9-816b-4c4ddd29f5dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:32.367613 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-959794a7-aa1c-44a9-816b-4c4ddd29f5dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:32.378142 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-959794a7-aa1c-44a9-816b-4c4ddd29f5dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:32.378766 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-959794a7-aa1c-44a9-816b-4c4ddd29f5dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:32.379663 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-959794a7-aa1c-44a9-816b-4c4ddd29f5dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:32.380288 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-959794a7-aa1c-44a9-816b-4c4ddd29f5dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:32.474046 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-dbc0c661-aaee-4cf2-8b94-799ac545ddaa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37abf47d-f6e3-4ce8-a076-c00dacefb402"}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:32.476290 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-dbc0c661-aaee-4cf2-8b94-799ac545ddaa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:32.484803 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dbc0c661-aaee-4cf2-8b94-799ac545ddaa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:32.485559 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dbc0c661-aaee-4cf2-8b94-799ac545ddaa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:32.486679 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dbc0c661-aaee-4cf2-8b94-799ac545ddaa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:32.487291 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dbc0c661-aaee-4cf2-8b94-799ac545ddaa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:32.564069 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-959794a7-aa1c-44a9-816b-4c4ddd29f5dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:32.566460 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-959794a7-aa1c-44a9-816b-4c4ddd29f5dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:32.568311 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-959794a7-aa1c-44a9-816b-4c4ddd29f5dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:32.569751 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-959794a7-aa1c-44a9-816b-4c4ddd29f5dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.207352 Jun 30 16:37:32.570898 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 229/462] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:32 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:32.746820 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-66f5c540-435c-4162-ab9b-aecbd6612ad2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:32.747417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-66f5c540-435c-4162-ab9b-aecbd6612ad2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:32.756202 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66f5c540-435c-4162-ab9b-aecbd6612ad2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:32.759571 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66f5c540-435c-4162-ab9b-aecbd6612ad2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:32.762037 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66f5c540-435c-4162-ab9b-aecbd6612ad2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:32.763878 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66f5c540-435c-4162-ab9b-aecbd6612ad2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:32.800887 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-66f5c540-435c-4162-ab9b-aecbd6612ad2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07/ips" status: 200 len: 149 microversion: 2.1 time: 0.058060 Jun 30 16:37:32.801390 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 230/463] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 30 16:37:32 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07/ips => generated 149 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:37:32.819360 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-be91bc60-a1ef-4e1c-91cf-1de8bbd0f5f4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "154a8320-9554-4bad-8822-7dccf82d319d"}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:32.823933 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-be91bc60-a1ef-4e1c-91cf-1de8bbd0f5f4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:32.841722 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-be91bc60-a1ef-4e1c-91cf-1de8bbd0f5f4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:32.842287 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-be91bc60-a1ef-4e1c-91cf-1de8bbd0f5f4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:32.843132 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-be91bc60-a1ef-4e1c-91cf-1de8bbd0f5f4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:32.844890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-be91bc60-a1ef-4e1c-91cf-1de8bbd0f5f4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:32.959974 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-be91bc60-a1ef-4e1c-91cf-1de8bbd0f5f4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] HTTP exception thrown: Invalid volume: volume 154a8320-9554-4bad-8822-7dccf82d319d is already attached to instances: 285f3262-38a1-4c65-9680-18fa2ef40c32 Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-be91bc60-a1ef-4e1c-91cf-1de8bbd0f5f4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Request method failure captured: Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: POST /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07/os-volume_attachments HTTP/1.1 Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 74 Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdByCRmKHFn3MWHXG9FHLumdqoFbcitofz3WTo4vIsqDgEdQTbCYdYkG6VrKJfwKSwNBul_mR6Pq6q8wsCNMbsOQVU-vBawcL74Th9xNCcWYhdHHThpX8bYg_ks1_lfyxu2cd7ltcDmgXQzda0-vc83XxV9QJd6mMtTnGfzh1bTh8BQ Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:37:32.962870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:37:32.965030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f942ab31bafc428bb1fba94aee2e0c32"}]}] Jun 30 16:37:32.965030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:37:32.965030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:37:32.965030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:37:32.965030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:37:32.965030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:37:32.965030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:37:32.965030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 0a26028451b345968fe86774f44736dd Jun 30 16:37:32.965030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:37:32.965030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Jun 30 16:37:32.965030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {"volumeAttachment": {"volumeId": "154a8320-9554-4bad-8822-7dccf82d319d"}} Jun 30 16:37:32.965030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Invalid volume: volume 154a8320-9554-4bad-8822-7dccf82d319d is already attached to instances: 285f3262-38a1-4c65-9680-18fa2ef40c32 Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'server_id': 'de05418a-11bf-401c-b0cb-52968e5d6d07', 'body': {'volumeAttachment': {'volumeId': '154a8320-9554-4bad-8822-7dccf82d319d'}}} Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 154a8320-9554-4bad-8822-7dccf82d319d is already attached to instances: 285f3262-38a1-4c65-9680-18fa2ef40c32 Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:32.965930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 154a8320-9554-4bad-8822-7dccf82d319d is already attached to instances: 285f3262-38a1-4c65-9680-18fa2ef40c32 Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:32.967309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:37:32.968622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:37:32.968622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:37:32.968622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:37:32.968622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 154a8320-9554-4bad-8822-7dccf82d319d is already attached to instances: 285f3262-38a1-4c65-9680-18fa2ef40c32 Jun 30 16:37:32.968622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:32.972681 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-be91bc60-a1ef-4e1c-91cf-1de8bbd0f5f4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Returning 400 to user: Invalid volume: volume 154a8320-9554-4bad-8822-7dccf82d319d is already attached to instances: 285f3262-38a1-4c65-9680-18fa2ef40c32 {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:37:32.973289 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-be91bc60-a1ef-4e1c-91cf-1de8bbd0f5f4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "POST /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.163704 Jun 30 16:37:32.978191 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 231/464] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 30 16:37:32 2022] POST /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07/os-volume_attachments => generated 174 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 30 16:37:32.985145 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-76353f61-2cc0-41d1-80c7-9b83f2c43e12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:32.985951 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-76353f61-2cc0-41d1-80c7-9b83f2c43e12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:33.023189 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-76353f61-2cc0-41d1-80c7-9b83f2c43e12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:33.024020 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-76353f61-2cc0-41d1-80c7-9b83f2c43e12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:33.025780 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-76353f61-2cc0-41d1-80c7-9b83f2c43e12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:33.027227 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-76353f61-2cc0-41d1-80c7-9b83f2c43e12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:33.088066 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-76353f61-2cc0-41d1-80c7-9b83f2c43e12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Going to try to terminate instance {{(pid=124815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:37:33.676064 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-76353f61-2cc0-41d1-80c7-9b83f2c43e12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 204 len: 0 microversion: 2.1 time: 0.692130 Jun 30 16:37:33.676936 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 232/465] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:37:32 2022] DELETE /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:37:33.682622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-edc8e28e-e9de-4ccc-b10b-7ff50b88c4ee tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:33.683706 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-edc8e28e-e9de-4ccc-b10b-7ff50b88c4ee tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:33.701242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-edc8e28e-e9de-4ccc-b10b-7ff50b88c4ee tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:33.702057 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-edc8e28e-e9de-4ccc-b10b-7ff50b88c4ee tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:33.703586 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-edc8e28e-e9de-4ccc-b10b-7ff50b88c4ee tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:33.704133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-edc8e28e-e9de-4ccc-b10b-7ff50b88c4ee tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:33.844002 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-edc8e28e-e9de-4ccc-b10b-7ff50b88c4ee tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:33.861240 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-edc8e28e-e9de-4ccc-b10b-7ff50b88c4ee tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1205 microversion: 2.1 time: 0.181129 Jun 30 16:37:33.862285 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 233/466] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:33 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1205 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:33.875844 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e33aee85-130d-4377-9d36-85b61e2bcafe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:33.877176 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e33aee85-130d-4377-9d36-85b61e2bcafe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:33.890216 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e33aee85-130d-4377-9d36-85b61e2bcafe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:33.891451 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e33aee85-130d-4377-9d36-85b61e2bcafe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:33.892683 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e33aee85-130d-4377-9d36-85b61e2bcafe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:33.893698 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e33aee85-130d-4377-9d36-85b61e2bcafe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:33.950286 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e33aee85-130d-4377-9d36-85b61e2bcafe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:33.950286 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e33aee85-130d-4377-9d36-85b61e2bcafe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:33.950450 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-e33aee85-130d-4377-9d36-85b61e2bcafe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lazy-loading 'fault' on Instance uuid 857e209a-1b96-4de8-aae0-f4b0091275c7 {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:37:34.085768 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e33aee85-130d-4377-9d36-85b61e2bcafe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:34.086452 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e33aee85-130d-4377-9d36-85b61e2bcafe tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1305 microversion: 2.1 time: 0.222897 Jun 30 16:37:34.087128 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 234/467] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:33 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1305 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:34.097820 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d2a96da5-b4f4-4ae7-828f-6c64210d3309 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:34.099620 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d2a96da5-b4f4-4ae7-828f-6c64210d3309 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:34.114085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d2a96da5-b4f4-4ae7-828f-6c64210d3309 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:34.115004 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d2a96da5-b4f4-4ae7-828f-6c64210d3309 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:34.116095 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d2a96da5-b4f4-4ae7-828f-6c64210d3309 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:34.116579 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d2a96da5-b4f4-4ae7-828f-6c64210d3309 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:34.195538 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d2a96da5-b4f4-4ae7-828f-6c64210d3309 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:34.202086 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d2a96da5-b4f4-4ae7-828f-6c64210d3309 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1471 microversion: 2.1 time: 0.113840 Jun 30 16:37:34.203011 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 235/468] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:34 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1471 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:34.216822 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-710b7dad-8374-4593-a6fc-88c211953bf8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:34.218194 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-710b7dad-8374-4593-a6fc-88c211953bf8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:34.227719 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-710b7dad-8374-4593-a6fc-88c211953bf8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:34.228230 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-710b7dad-8374-4593-a6fc-88c211953bf8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:34.229689 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-710b7dad-8374-4593-a6fc-88c211953bf8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:34.230275 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-710b7dad-8374-4593-a6fc-88c211953bf8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:34.255248 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-dbc0c661-aaee-4cf2-8b94-799ac545ddaa tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "POST /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.785228 Jun 30 16:37:34.260110 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 234/469] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 30 16:37:32 2022] POST /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments => generated 194 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:37:34.292921 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7635ed63-19b4-43f4-bb67-f3dfb11d81b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:34.294173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7635ed63-19b4-43f4-bb67-f3dfb11d81b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:34.304721 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7635ed63-19b4-43f4-bb67-f3dfb11d81b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:34.305394 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7635ed63-19b4-43f4-bb67-f3dfb11d81b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:34.307063 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7635ed63-19b4-43f4-bb67-f3dfb11d81b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:34.308726 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7635ed63-19b4-43f4-bb67-f3dfb11d81b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:34.600101 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-710b7dad-8374-4593-a6fc-88c211953bf8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:34.611242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-710b7dad-8374-4593-a6fc-88c211953bf8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:34.617101 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-710b7dad-8374-4593-a6fc-88c211953bf8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:34.624769 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-710b7dad-8374-4593-a6fc-88c211953bf8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.415689 Jun 30 16:37:34.625384 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 236/470] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:34 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:34.639624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-2900cfe2-4dad-468e-afea-caf9b9865e9b req-5765deb0-11e8-45ea-a025-7defa3ce8979 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc03842b-e56f-4828-99c9-0b175cd2277f", "name": "network-vif-deleted", "tag": "3f33f308-ce97-4120-965f-b9d4d472b4a5"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:34.666216 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-2900cfe2-4dad-468e-afea-caf9b9865e9b req-5765deb0-11e8-45ea-a025-7defa3ce8979 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:34.666721 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-2900cfe2-4dad-468e-afea-caf9b9865e9b req-5765deb0-11e8-45ea-a025-7defa3ce8979 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:34.685083 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7635ed63-19b4-43f4-bb67-f3dfb11d81b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:34.698162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7635ed63-19b4-43f4-bb67-f3dfb11d81b7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1680 microversion: 2.1 time: 0.435288 Jun 30 16:37:34.701032 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 235/471] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:34 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1680 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:34.706300 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-2900cfe2-4dad-468e-afea-caf9b9865e9b req-5765deb0-11e8-45ea-a025-7defa3ce8979 service nova] Creating event network-vif-deleted:3f33f308-ce97-4120-965f-b9d4d472b4a5 for instance cc03842b-e56f-4828-99c9-0b175cd2277f on hv-cinder-83602 Jun 30 16:37:34.730145 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-2900cfe2-4dad-468e-afea-caf9b9865e9b req-5765deb0-11e8-45ea-a025-7defa3ce8979 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102851 Jun 30 16:37:34.732525 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 237/472] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:37:34.905581 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-fc035ba0-ade4-465c-93e2-1d1350c67c27 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:34.906460 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-fc035ba0-ade4-465c-93e2-1d1350c67c27 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:34.917693 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fc035ba0-ade4-465c-93e2-1d1350c67c27 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:34.918472 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fc035ba0-ade4-465c-93e2-1d1350c67c27 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:34.919581 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fc035ba0-ade4-465c-93e2-1d1350c67c27 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:34.920365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fc035ba0-ade4-465c-93e2-1d1350c67c27 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:35.109938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-bd5f211a-5f17-4c79-a42f-5a88c65e0384 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:35.111190 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-bd5f211a-5f17-4c79-a42f-5a88c65e0384 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:35.128706 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bd5f211a-5f17-4c79-a42f-5a88c65e0384 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:35.133252 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bd5f211a-5f17-4c79-a42f-5a88c65e0384 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:35.133252 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bd5f211a-5f17-4c79-a42f-5a88c65e0384 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:35.133252 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bd5f211a-5f17-4c79-a42f-5a88c65e0384 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:35.274870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bd5f211a-5f17-4c79-a42f-5a88c65e0384 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:35.276648 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bd5f211a-5f17-4c79-a42f-5a88c65e0384 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:35.277450 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-bd5f211a-5f17-4c79-a42f-5a88c65e0384 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lazy-loading 'fault' on Instance uuid 857e209a-1b96-4de8-aae0-f4b0091275c7 {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:37:35.612139 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-bd5f211a-5f17-4c79-a42f-5a88c65e0384 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '936a4ad02f06446f90bea6d95eb17b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ec9078457f461db05068580817ab69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:35.629764 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-bd5f211a-5f17-4c79-a42f-5a88c65e0384 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 200 len: 1305 microversion: 2.1 time: 0.524807 Jun 30 16:37:35.631203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 238/473] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:35 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 1305 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:35.640047 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9d891987-a50e-4cad-b15a-12c54f6669e3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:35.641126 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9d891987-a50e-4cad-b15a-12c54f6669e3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:35.652690 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9d891987-a50e-4cad-b15a-12c54f6669e3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:35.660026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9d891987-a50e-4cad-b15a-12c54f6669e3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:35.682828 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9d891987-a50e-4cad-b15a-12c54f6669e3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:35.684648 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9d891987-a50e-4cad-b15a-12c54f6669e3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:35.797682 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9d891987-a50e-4cad-b15a-12c54f6669e3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:35.807072 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9d891987-a50e-4cad-b15a-12c54f6669e3 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1303 microversion: 2.1 time: 0.174251 Jun 30 16:37:35.810226 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 239/474] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:35 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1303 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:35.827539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-22c66c04-c2a2-45e1-9ff6-9d5d15bd2971 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:35.828159 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-22c66c04-c2a2-45e1-9ff6-9d5d15bd2971 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:35.836739 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-22c66c04-c2a2-45e1-9ff6-9d5d15bd2971 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:35.844072 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-22c66c04-c2a2-45e1-9ff6-9d5d15bd2971 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:35.845185 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-22c66c04-c2a2-45e1-9ff6-9d5d15bd2971 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:35.845590 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-fc035ba0-ade4-465c-93e2-1d1350c67c27 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:35.846363 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-22c66c04-c2a2-45e1-9ff6-9d5d15bd2971 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:35.857126 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-fc035ba0-ade4-465c-93e2-1d1350c67c27 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1272 microversion: 2.1 time: 0.980787 Jun 30 16:37:35.858862 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 236/475] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:34 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1272 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:35.864365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6a45c737-4240-4b47-9c22-63e0401fe170 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:35.865078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6a45c737-4240-4b47-9c22-63e0401fe170 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:35.886950 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:35.899828 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6a45c737-4240-4b47-9c22-63e0401fe170 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:35.903914 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6a45c737-4240-4b47-9c22-63e0401fe170 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:35.906137 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6a45c737-4240-4b47-9c22-63e0401fe170 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:35.907288 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6a45c737-4240-4b47-9c22-63e0401fe170 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:36.272475 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-22c66c04-c2a2-45e1-9ff6-9d5d15bd2971 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:36.293987 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-22c66c04-c2a2-45e1-9ff6-9d5d15bd2971 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:36.298123 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6a45c737-4240-4b47-9c22-63e0401fe170 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:36.301373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-22c66c04-c2a2-45e1-9ff6-9d5d15bd2971 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:36.306055 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-22c66c04-c2a2-45e1-9ff6-9d5d15bd2971 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.492435 Jun 30 16:37:36.306214 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6a45c737-4240-4b47-9c22-63e0401fe170 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1680 microversion: 2.1 time: 0.446939 Jun 30 16:37:36.306774 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 237/476] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:35 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1680 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:36.311051 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 240/477] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:35 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:36.648076 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3aa25c3f-4ade-41b4-9ef4-1e6c03344473 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:36.648785 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3aa25c3f-4ade-41b4-9ef4-1e6c03344473 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] [instance: 857e209a-1b96-4de8-aae0-f4b0091275c7] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:36.659074 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3aa25c3f-4ade-41b4-9ef4-1e6c03344473 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:36.659553 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3aa25c3f-4ade-41b4-9ef4-1e6c03344473 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:36.660343 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3aa25c3f-4ade-41b4-9ef4-1e6c03344473 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:36.660761 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3aa25c3f-4ade-41b4-9ef4-1e6c03344473 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:36.699089 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-3aa25c3f-4ade-41b4-9ef4-1e6c03344473 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] HTTP exception thrown: Instance 857e209a-1b96-4de8-aae0-f4b0091275c7 could not be found. Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3aa25c3f-4ade-41b4-9ef4-1e6c03344473 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Request method failure captured: Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 HTTP/1.1 Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdEcbmmy094MOib33DgKGlC7GgWL9HBdqJtqG6WZERlCnYtq-jjAVE8ZaoJigk2MrqF5w2kS_jUAogxheQYnLUV0IaNrX8J-wXdDandTISsg7Cge1B6hjjcCVQX1lyUh0avgVu87CFAB0SBzJXRTStA548HdoVnbnwTKfUsZ1JWcarc Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 62ec9078457f461db05068580817ab69 Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-VolumesNegativeTest-909930259 Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:37:36.707043 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:37:36.708847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62ec9078457f461db05068580817ab69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/62ec9078457f461db05068580817ab69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_62ec9078457f461db05068580817ab69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/62ec9078457f461db05068580817ab69"}]}] Jun 30 16:37:36.708847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-VolumesNegativeTest-909930259 Jun 30 16:37:36.708847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 62ec9078457f461db05068580817ab69 Jun 30 16:37:36.708847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-VolumesNegativeTest-909930259 Jun 30 16:37:36.708847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-VolumesNegativeTest-909930259-project Jun 30 16:37:36.708847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:37:36.708847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:37:36.708847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 936a4ad02f06446f90bea6d95eb17b70 Jun 30 16:37:36.708847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-VolumesNegativeTest-909930259-project Jun 30 16:37:36.708847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:37:36.708847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance 857e209a-1b96-4de8-aae0-f4b0091275c7 could not be found. Jun 30 16:37:36.708847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': '857e209a-1b96-4de8-aae0-f4b0091275c7'} Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 857e209a-1b96-4de8-aae0-f4b0091275c7 could not be found. Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:37:36.709729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 857e209a-1b96-4de8-aae0-f4b0091275c7 could not be found. Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 857e209a-1b96-4de8-aae0-f4b0091275c7 could not be found. Jun 30 16:37:36.711144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:37:36.712459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3aa25c3f-4ade-41b4-9ef4-1e6c03344473 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] Returning 404 to user: Instance 857e209a-1b96-4de8-aae0-f4b0091275c7 could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:37:36.712459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3aa25c3f-4ade-41b4-9ef4-1e6c03344473 tempest-VolumesNegativeTest-909930259 tempest-VolumesNegativeTest-909930259-project] 10.222.0.67 "GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7" status: 404 len: 111 microversion: 2.1 time: 0.058205 Jun 30 16:37:36.712459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 238/478] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:36 2022] GET /compute/v2.1/servers/857e209a-1b96-4de8-aae0-f4b0091275c7 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:37:36.826147 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-78bbb50d-8f3f-4d16-a9be-0771dc17b136 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:36.827523 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-78bbb50d-8f3f-4d16-a9be-0771dc17b136 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:36.840241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78bbb50d-8f3f-4d16-a9be-0771dc17b136 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:36.841116 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78bbb50d-8f3f-4d16-a9be-0771dc17b136 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:36.848751 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78bbb50d-8f3f-4d16-a9be-0771dc17b136 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:36.849654 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78bbb50d-8f3f-4d16-a9be-0771dc17b136 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:36.887129 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e3dba5ed-1d0a-406e-a0e6-55539d2d94e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:36.893958 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e3dba5ed-1d0a-406e-a0e6-55539d2d94e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:36.896577 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e3dba5ed-1d0a-406e-a0e6-55539d2d94e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:36.897796 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e3dba5ed-1d0a-406e-a0e6-55539d2d94e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:36.898960 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e3dba5ed-1d0a-406e-a0e6-55539d2d94e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:36.899950 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e3dba5ed-1d0a-406e-a0e6-55539d2d94e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:36.927640 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78bbb50d-8f3f-4d16-a9be-0771dc17b136 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:36.928104 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78bbb50d-8f3f-4d16-a9be-0771dc17b136 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:36.928583 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-78bbb50d-8f3f-4d16-a9be-0771dc17b136 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lazy-loading 'fault' on Instance uuid cc03842b-e56f-4828-99c9-0b175cd2277f {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:37:37.104325 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-78bbb50d-8f3f-4d16-a9be-0771dc17b136 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:37.128999 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-78bbb50d-8f3f-4d16-a9be-0771dc17b136 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 200 len: 1308 microversion: 2.1 time: 0.306722 Jun 30 16:37:37.129902 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 241/479] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:36 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:37.141080 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-9e36b741-36cf-4d62-9d03-f1395a93f6d7 req-0948c167-7dc4-45b5-98a1-fead962fc9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d4ed30-dc39-4be8-b345-360410abdc13", "tag": "ab01136b-ddb4-42c0-b8a6-880714395a42"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:37.160122 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-9e36b741-36cf-4d62-9d03-f1395a93f6d7 req-0948c167-7dc4-45b5-98a1-fead962fc9f8 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:37.181639 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-9e36b741-36cf-4d62-9d03-f1395a93f6d7 req-0948c167-7dc4-45b5-98a1-fead962fc9f8 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:37.209089 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-9e36b741-36cf-4d62-9d03-f1395a93f6d7 req-0948c167-7dc4-45b5-98a1-fead962fc9f8 service nova] Creating event network-changed:ab01136b-ddb4-42c0-b8a6-880714395a42 for instance 68d4ed30-dc39-4be8-b345-360410abdc13 on hv-cinder-83602 Jun 30 16:37:37.221508 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-9e36b741-36cf-4d62-9d03-f1395a93f6d7 req-0948c167-7dc4-45b5-98a1-fead962fc9f8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085959 Jun 30 16:37:37.223176 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 242/480] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:37:37.327734 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6174e0dc-3666-4ec0-aae0-29f46dba446d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:37.328499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6174e0dc-3666-4ec0-aae0-29f46dba446d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:37.340419 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-e3dba5ed-1d0a-406e-a0e6-55539d2d94e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:37.342593 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6174e0dc-3666-4ec0-aae0-29f46dba446d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:37.343227 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6174e0dc-3666-4ec0-aae0-29f46dba446d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:37.344280 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6174e0dc-3666-4ec0-aae0-29f46dba446d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:37.348262 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6174e0dc-3666-4ec0-aae0-29f46dba446d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:37.359015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e3dba5ed-1d0a-406e-a0e6-55539d2d94e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1260 microversion: 2.1 time: 0.474154 Jun 30 16:37:37.371804 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 239/481] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:36 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1260 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:37.387593 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5976058f-3303-4e4b-810d-c3e16c0259d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:37.388716 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5976058f-3303-4e4b-810d-c3e16c0259d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:37.397167 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5976058f-3303-4e4b-810d-c3e16c0259d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:37.397919 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5976058f-3303-4e4b-810d-c3e16c0259d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:37.398919 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5976058f-3303-4e4b-810d-c3e16c0259d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:37.399599 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5976058f-3303-4e4b-810d-c3e16c0259d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:37.512731 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6174e0dc-3666-4ec0-aae0-29f46dba446d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:37.524021 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6174e0dc-3666-4ec0-aae0-29f46dba446d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1612 microversion: 2.1 time: 0.203416 Jun 30 16:37:37.535163 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 243/482] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:37 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1612 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:38.134830 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5976058f-3303-4e4b-810d-c3e16c0259d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:38.145660 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5976058f-3303-4e4b-810d-c3e16c0259d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:38.147906 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5976058f-3303-4e4b-810d-c3e16c0259d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:38.149088 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5976058f-3303-4e4b-810d-c3e16c0259d6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.775999 Jun 30 16:37:38.149478 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ff1caba8-c192-4679-87b7-9b55f6640f0d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:38.150046 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 240/483] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:37 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:38.150425 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ff1caba8-c192-4679-87b7-9b55f6640f0d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: cc03842b-e56f-4828-99c9-0b175cd2277f] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:38.167580 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ff1caba8-c192-4679-87b7-9b55f6640f0d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:38.168744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ff1caba8-c192-4679-87b7-9b55f6640f0d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:38.169871 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ff1caba8-c192-4679-87b7-9b55f6640f0d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:38.170390 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ff1caba8-c192-4679-87b7-9b55f6640f0d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:38.191068 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-ff1caba8-c192-4679-87b7-9b55f6640f0d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] HTTP exception thrown: Instance cc03842b-e56f-4828-99c9-0b175cd2277f could not be found. Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ff1caba8-c192-4679-87b7-9b55f6640f0d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Request method failure captured: Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f HTTP/1.1 Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdDstG7FtaZjuck8CZSgzel5KlA1Ns-og4bFYD1M-TM6R6yTU_Waj7zQSKjJom8tTD8WIfQtJkeh-EqNf8BYq1CRCjrx2AYntIoolU5HyFSgflRElRvsU9BNpT43pKjAYdaHwyF2xJ0NbaWGQFl4XEwb5Nb9eMSQAJ2gnBp1OWWPkak Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: 4df4c3aa7c8044dcbd46064e0e495a84 Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-VolumesSnapshotTestJSON-307117237 Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:37:38.200085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:37:38.201569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4df4c3aa7c8044dcbd46064e0e495a84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4df4c3aa7c8044dcbd46064e0e495a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4df4c3aa7c8044dcbd46064e0e495a84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4df4c3aa7c8044dcbd46064e0e495a84"}]}] Jun 30 16:37:38.201569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-VolumesSnapshotTestJSON-307117237 Jun 30 16:37:38.201569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: 4df4c3aa7c8044dcbd46064e0e495a84 Jun 30 16:37:38.201569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-307117237 Jun 30 16:37:38.201569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-VolumesSnapshotTestJSON-307117237-project Jun 30 16:37:38.201569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:37:38.201569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:37:38.201569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 96d7af5479ce46b99e333d91128b826e Jun 30 16:37:38.201569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-VolumesSnapshotTestJSON-307117237-project Jun 30 16:37:38.201569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:37:38.201569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance cc03842b-e56f-4828-99c9-0b175cd2277f could not be found. Jun 30 16:37:38.201569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'cc03842b-e56f-4828-99c9-0b175cd2277f'} Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc03842b-e56f-4828-99c9-0b175cd2277f could not be found. Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:37:38.202417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc03842b-e56f-4828-99c9-0b175cd2277f could not be found. Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc03842b-e56f-4828-99c9-0b175cd2277f could not be found. Jun 30 16:37:38.203890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:38.206681 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ff1caba8-c192-4679-87b7-9b55f6640f0d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Returning 404 to user: Instance cc03842b-e56f-4828-99c9-0b175cd2277f could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:37:38.207768 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ff1caba8-c192-4679-87b7-9b55f6640f0d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f" status: 404 len: 111 microversion: 2.1 time: 0.062422 Jun 30 16:37:38.213603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 244/484] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:38 2022] GET /compute/v2.1/servers/cc03842b-e56f-4828-99c9-0b175cd2277f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 16:37:38.378279 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3ddd616c-9b59-4897-a70e-8756435cd4fc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:38.379264 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3ddd616c-9b59-4897-a70e-8756435cd4fc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:38.390805 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3ddd616c-9b59-4897-a70e-8756435cd4fc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:38.391659 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3ddd616c-9b59-4897-a70e-8756435cd4fc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:38.392811 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3ddd616c-9b59-4897-a70e-8756435cd4fc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:38.393465 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3ddd616c-9b59-4897-a70e-8756435cd4fc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:38.543316 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0edba2e2-766a-4e38-af56-b4539a61abdf tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:38.544118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-0edba2e2-766a-4e38-af56-b4539a61abdf tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:38.554486 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0edba2e2-766a-4e38-af56-b4539a61abdf tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:38.554953 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0edba2e2-766a-4e38-af56-b4539a61abdf tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:38.557369 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0edba2e2-766a-4e38-af56-b4539a61abdf tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:38.564216 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0edba2e2-766a-4e38-af56-b4539a61abdf tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:38.605662 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3ddd616c-9b59-4897-a70e-8756435cd4fc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:38.617996 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3ddd616c-9b59-4897-a70e-8756435cd4fc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1260 microversion: 2.1 time: 0.243372 Jun 30 16:37:38.619993 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 241/485] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:38 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1260 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:38.697580 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-0edba2e2-766a-4e38-af56-b4539a61abdf tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:38.713271 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-0edba2e2-766a-4e38-af56-b4539a61abdf tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1325 microversion: 2.1 time: 0.174102 Jun 30 16:37:38.717733 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 245/486] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:38 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1325 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:39.178187 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8a651fa9-9ef1-42ca-8644-9847fa3f25f1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:39.178807 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8a651fa9-9ef1-42ca-8644-9847fa3f25f1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:39.190554 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8a651fa9-9ef1-42ca-8644-9847fa3f25f1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:39.193596 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8a651fa9-9ef1-42ca-8644-9847fa3f25f1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:39.194738 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8a651fa9-9ef1-42ca-8644-9847fa3f25f1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:39.195197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8a651fa9-9ef1-42ca-8644-9847fa3f25f1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:39.314013 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-0e4fb252-db46-40c0-9ba8-76d420fb6cfd req-06f3ba70-433e-440f-957d-95cba41cad7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de05418a-11bf-401c-b0cb-52968e5d6d07", "name": "network-vif-deleted", "tag": "5d6aee83-8fca-4ec9-8a36-9eed297963c5"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:39.346035 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-0e4fb252-db46-40c0-9ba8-76d420fb6cfd req-06f3ba70-433e-440f-957d-95cba41cad7c service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:39.353678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-0e4fb252-db46-40c0-9ba8-76d420fb6cfd req-06f3ba70-433e-440f-957d-95cba41cad7c service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:39.377481 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-0e4fb252-db46-40c0-9ba8-76d420fb6cfd req-06f3ba70-433e-440f-957d-95cba41cad7c service nova] Creating event network-vif-deleted:5d6aee83-8fca-4ec9-8a36-9eed297963c5 for instance de05418a-11bf-401c-b0cb-52968e5d6d07 on hv-cinder-83602 Jun 30 16:37:39.388253 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-0e4fb252-db46-40c0-9ba8-76d420fb6cfd req-06f3ba70-433e-440f-957d-95cba41cad7c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077868 Jun 30 16:37:39.391610 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 246/487] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:37:39.490111 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8a651fa9-9ef1-42ca-8644-9847fa3f25f1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:39.512144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8a651fa9-9ef1-42ca-8644-9847fa3f25f1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:39.516853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8a651fa9-9ef1-42ca-8644-9847fa3f25f1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:39.520272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8a651fa9-9ef1-42ca-8644-9847fa3f25f1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.347038 Jun 30 16:37:39.521094 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 242/488] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:39 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:39.635730 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ce8fc2ca-784c-4e32-9143-5c14062a5120 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:39.636954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ce8fc2ca-784c-4e32-9143-5c14062a5120 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:39.647482 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ce8fc2ca-784c-4e32-9143-5c14062a5120 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:39.649446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ce8fc2ca-784c-4e32-9143-5c14062a5120 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:39.650383 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ce8fc2ca-784c-4e32-9143-5c14062a5120 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:39.652635 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ce8fc2ca-784c-4e32-9143-5c14062a5120 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:39.737973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-df85407e-9ea5-43d3-b483-ead5651b0396 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:39.741915 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-df85407e-9ea5-43d3-b483-ead5651b0396 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:39.770700 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-df85407e-9ea5-43d3-b483-ead5651b0396 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:39.772432 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-df85407e-9ea5-43d3-b483-ead5651b0396 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:39.779120 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-df85407e-9ea5-43d3-b483-ead5651b0396 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:39.780192 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-df85407e-9ea5-43d3-b483-ead5651b0396 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:39.861733 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-df85407e-9ea5-43d3-b483-ead5651b0396 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:39.862463 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-df85407e-9ea5-43d3-b483-ead5651b0396 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:39.868266 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-df85407e-9ea5-43d3-b483-ead5651b0396 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lazy-loading 'fault' on Instance uuid de05418a-11bf-401c-b0cb-52968e5d6d07 {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:37:39.935819 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-df85407e-9ea5-43d3-b483-ead5651b0396 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:39.939707 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:39.973418 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-df85407e-9ea5-43d3-b483-ead5651b0396 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1330 microversion: 2.1 time: 0.246792 Jun 30 16:37:39.976475 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 243/489] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:39 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1330 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:39.987909 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ce8fc2ca-784c-4e32-9143-5c14062a5120 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:40.005325 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ce8fc2ca-784c-4e32-9143-5c14062a5120 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1260 microversion: 2.1 time: 0.373783 Jun 30 16:37:40.011620 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 247/490] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:39 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1260 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:40.546107 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9259a375-c1d9-47cd-ab58-6ce8f0b7e352 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:40.546769 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9259a375-c1d9-47cd-ab58-6ce8f0b7e352 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:40.561562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9259a375-c1d9-47cd-ab58-6ce8f0b7e352 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:40.562028 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9259a375-c1d9-47cd-ab58-6ce8f0b7e352 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:40.562810 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9259a375-c1d9-47cd-ab58-6ce8f0b7e352 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:40.563419 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9259a375-c1d9-47cd-ab58-6ce8f0b7e352 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:40.827653 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9259a375-c1d9-47cd-ab58-6ce8f0b7e352 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:40.838401 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9259a375-c1d9-47cd-ab58-6ce8f0b7e352 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:40.841868 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9259a375-c1d9-47cd-ab58-6ce8f0b7e352 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:40.843569 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9259a375-c1d9-47cd-ab58-6ce8f0b7e352 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.307817 Jun 30 16:37:40.845281 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 244/491] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:40 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:40.997130 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1220c7be-4a62-46eb-a87c-fc19d3eff09c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:40.999993 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1220c7be-4a62-46eb-a87c-fc19d3eff09c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:41.012210 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1220c7be-4a62-46eb-a87c-fc19d3eff09c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:41.012675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1220c7be-4a62-46eb-a87c-fc19d3eff09c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:41.013614 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1220c7be-4a62-46eb-a87c-fc19d3eff09c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:41.014071 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1220c7be-4a62-46eb-a87c-fc19d3eff09c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:41.028634 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7589a4b8-8c12-43fc-88c4-d258db9c697b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:41.029272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7589a4b8-8c12-43fc-88c4-d258db9c697b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:41.037706 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7589a4b8-8c12-43fc-88c4-d258db9c697b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:41.039138 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7589a4b8-8c12-43fc-88c4-d258db9c697b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:41.041917 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7589a4b8-8c12-43fc-88c4-d258db9c697b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:41.043322 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7589a4b8-8c12-43fc-88c4-d258db9c697b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:41.065343 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1220c7be-4a62-46eb-a87c-fc19d3eff09c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:41.065990 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1220c7be-4a62-46eb-a87c-fc19d3eff09c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:41.066608 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-1220c7be-4a62-46eb-a87c-fc19d3eff09c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lazy-loading 'fault' on Instance uuid de05418a-11bf-401c-b0cb-52968e5d6d07 {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:37:41.124827 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1220c7be-4a62-46eb-a87c-fc19d3eff09c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:41.140267 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1220c7be-4a62-46eb-a87c-fc19d3eff09c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1330 microversion: 2.1 time: 0.141372 Jun 30 16:37:41.151311 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 248/492] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:40 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1330 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:41.306656 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7589a4b8-8c12-43fc-88c4-d258db9c697b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:41.315428 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7589a4b8-8c12-43fc-88c4-d258db9c697b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1260 microversion: 2.1 time: 0.293042 Jun 30 16:37:41.319582 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 245/493] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:41 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1260 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:41.865096 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-5b1f0902-9d47-4feb-b407-43a325f49899 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:41.866115 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-5b1f0902-9d47-4feb-b407-43a325f49899 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:41.873914 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5b1f0902-9d47-4feb-b407-43a325f49899 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:41.879919 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5b1f0902-9d47-4feb-b407-43a325f49899 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:41.880894 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5b1f0902-9d47-4feb-b407-43a325f49899 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:41.881356 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5b1f0902-9d47-4feb-b407-43a325f49899 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:42.062154 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5b1f0902-9d47-4feb-b407-43a325f49899 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:42.084867 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5b1f0902-9d47-4feb-b407-43a325f49899 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:42.086768 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5b1f0902-9d47-4feb-b407-43a325f49899 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:42.088252 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-5b1f0902-9d47-4feb-b407-43a325f49899 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.227464 Jun 30 16:37:42.089141 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 249/494] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:41 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:42.159024 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-782caf2c-e5cf-4d0b-8866-8bfcca5b7712 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:42.160462 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-782caf2c-e5cf-4d0b-8866-8bfcca5b7712 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:42.172031 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-782caf2c-e5cf-4d0b-8866-8bfcca5b7712 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:42.172490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-782caf2c-e5cf-4d0b-8866-8bfcca5b7712 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:42.173549 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-782caf2c-e5cf-4d0b-8866-8bfcca5b7712 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:42.173996 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-782caf2c-e5cf-4d0b-8866-8bfcca5b7712 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:42.218194 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-782caf2c-e5cf-4d0b-8866-8bfcca5b7712 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:42.218615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-782caf2c-e5cf-4d0b-8866-8bfcca5b7712 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:42.219093 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-782caf2c-e5cf-4d0b-8866-8bfcca5b7712 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lazy-loading 'fault' on Instance uuid de05418a-11bf-401c-b0cb-52968e5d6d07 {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:37:42.272462 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-782caf2c-e5cf-4d0b-8866-8bfcca5b7712 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:42.294210 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-782caf2c-e5cf-4d0b-8866-8bfcca5b7712 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 200 len: 1330 microversion: 2.1 time: 0.140297 Jun 30 16:37:42.296960 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 246/495] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:42 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 1330 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:42.337393 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1e5a5221-a8a8-4db2-900f-2d1e127e66bc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:42.338394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1e5a5221-a8a8-4db2-900f-2d1e127e66bc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:42.357392 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1e5a5221-a8a8-4db2-900f-2d1e127e66bc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:42.357392 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1e5a5221-a8a8-4db2-900f-2d1e127e66bc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:42.368082 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1e5a5221-a8a8-4db2-900f-2d1e127e66bc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:42.368690 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1e5a5221-a8a8-4db2-900f-2d1e127e66bc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:42.583586 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1e5a5221-a8a8-4db2-900f-2d1e127e66bc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:42.594892 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1e5a5221-a8a8-4db2-900f-2d1e127e66bc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1260 microversion: 2.1 time: 0.262805 Jun 30 16:37:42.594892 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 250/496] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:42 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:42.605302 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6d0d21bb-330d-4bf5-9794-59693c50677f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:42.606118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6d0d21bb-330d-4bf5-9794-59693c50677f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:42.612564 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d0d21bb-330d-4bf5-9794-59693c50677f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:42.613224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d0d21bb-330d-4bf5-9794-59693c50677f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:42.614158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d0d21bb-330d-4bf5-9794-59693c50677f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:42.614748 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d0d21bb-330d-4bf5-9794-59693c50677f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:42.650781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-02ccfd33-9db2-4276-ae2e-e2e42113b132 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Action: 'create', calling method: .version_select at 0x7f3820394ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1686313724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdDwjDx6Mc9vnRS9Vacd1DdkYvLOJ0FtrlUWLqw54qeoXIQAYsdNPpHdMM8XMdRF6EDW/X53iwSY0DZs7f3OxAWuLCmq4Bj0fX6+dabpRDQzxr7q9VIYoTND7SkAQl0Vg=="}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:42.668713 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-02ccfd33-9db2-4276-ae2e-e2e42113b132 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Getting quotas for project 99847b649bfd4ca6a33cb2ea97ad0469. Resources: {'key_pairs'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:37:42.677313 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-02ccfd33-9db2-4276-ae2e-e2e42113b132 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Getting quotas for user bb8a8a4e8b634322a92992379c98b721 and project 99847b649bfd4ca6a33cb2ea97ad0469. Resources: {'key_pairs'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:37:42.760712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-6d0d21bb-330d-4bf5-9794-59693c50677f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lazy-loading 'services' on Instance uuid 32f21182-53c1-471e-b55f-3f5654e72daf {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:37:42.777616 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-02ccfd33-9db2-4276-ae2e-e2e42113b132 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.443107 Jun 30 16:37:42.780822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 247/497] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 30 16:37:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:37:43.109230 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-17f49463-91d7-43fb-8f16-2033c6156ce7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:43.110075 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-17f49463-91d7-43fb-8f16-2033c6156ce7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:43.122291 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-17f49463-91d7-43fb-8f16-2033c6156ce7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:43.122879 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-17f49463-91d7-43fb-8f16-2033c6156ce7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:43.125622 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-17f49463-91d7-43fb-8f16-2033c6156ce7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:43.126465 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-17f49463-91d7-43fb-8f16-2033c6156ce7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:43.383172 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-17f49463-91d7-43fb-8f16-2033c6156ce7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:43.396873 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-17f49463-91d7-43fb-8f16-2033c6156ce7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:43.399347 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-17f49463-91d7-43fb-8f16-2033c6156ce7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:43.402772 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-17f49463-91d7-43fb-8f16-2033c6156ce7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.297782 Jun 30 16:37:43.416847 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6d0d21bb-330d-4bf5-9794-59693c50677f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "DELETE /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/os-volume_attachments/d7f413e5-4c09-452c-a8ed-a6886542ca3f" status: 202 len: 0 microversion: 2.1 time: 0.815309 Jun 30 16:37:43.420414 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 251/499] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 30 16:37:42 2022] DELETE /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/os-volume_attachments/d7f413e5-4c09-452c-a8ed-a6886542ca3f => generated 0 bytes in 827 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:37:43.428917 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 248/499] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:43 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:43.446502 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8f77e8a7-f638-41ca-95aa-99e3c1904687 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:43.447447 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8f77e8a7-f638-41ca-95aa-99e3c1904687 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:43.454440 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8f77e8a7-f638-41ca-95aa-99e3c1904687 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:43.455076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8f77e8a7-f638-41ca-95aa-99e3c1904687 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:43.456179 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8f77e8a7-f638-41ca-95aa-99e3c1904687 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:43.456845 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8f77e8a7-f638-41ca-95aa-99e3c1904687 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:43.473820 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-8f77e8a7-f638-41ca-95aa-99e3c1904687 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] HTTP exception thrown: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8f77e8a7-f638-41ca-95aa-99e3c1904687 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Request method failure captured: Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 HTTP/1.1 Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdByCRmKHFn3MWHXG9FHLumdqoFbcitofz3WTo4vIsqDgEdQTbCYdYkG6VrKJfwKSwNBul_mR6Pq6q8wsCNMbsOQVU-vBawcL74Th9xNCcWYhdHHThpX8bYg_ks1_lfyxu2cd7ltcDmgXQzda0-vc83XxV9QJd6mMtTnGfzh1bTh8BQ Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:37:43.484224 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:37:43.485562 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f942ab31bafc428bb1fba94aee2e0c32"}]}] Jun 30 16:37:43.485562 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:37:43.485562 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:37:43.485562 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:37:43.485562 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:37:43.485562 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:37:43.485562 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:37:43.485562 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 0a26028451b345968fe86774f44736dd Jun 30 16:37:43.485562 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:37:43.485562 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:37:43.485562 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:37:43.485562 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'de05418a-11bf-401c-b0cb-52968e5d6d07'} Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:37:43.486485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:37:43.487675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:43.488712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8f77e8a7-f638-41ca-95aa-99e3c1904687 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Returning 404 to user: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:37:43.488712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8f77e8a7-f638-41ca-95aa-99e3c1904687 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 404 len: 111 microversion: 2.1 time: 0.053944 Jun 30 16:37:43.488712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 252/500] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:43 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:37:43.490314 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-88895b77-0718-41c5-817e-7d1344431f25 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '.version_select at 0x7f38202681f0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:43.609856 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-eab6bcf3-21a7-4974-b871-40d3289d5414 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:43.610573 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-eab6bcf3-21a7-4974-b871-40d3289d5414 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:43.614321 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-88895b77-0718-41c5-817e-7d1344431f25 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732624792" status: 202 len: 0 microversion: 2.1 time: 0.129510 Jun 30 16:37:43.615268 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 249/501] 10.222.0.67 () {58 vars in 1220 bytes} [Thu Jun 30 16:37:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1732624792 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:37:43.620699 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-eab6bcf3-21a7-4974-b871-40d3289d5414 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:43.621160 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-eab6bcf3-21a7-4974-b871-40d3289d5414 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:43.621957 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-eab6bcf3-21a7-4974-b871-40d3289d5414 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:43.623743 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-eab6bcf3-21a7-4974-b871-40d3289d5414 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:43.843862 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-eab6bcf3-21a7-4974-b871-40d3289d5414 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:43.852895 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-eab6bcf3-21a7-4974-b871-40d3289d5414 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1260 microversion: 2.1 time: 0.246952 Jun 30 16:37:43.853713 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 253/502] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:43 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:44.429697 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d865ef2c-0b3c-46d4-8bd0-fabdf750b465 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:44.431048 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d865ef2c-0b3c-46d4-8bd0-fabdf750b465 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:44.440484 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d865ef2c-0b3c-46d4-8bd0-fabdf750b465 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:44.441464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d865ef2c-0b3c-46d4-8bd0-fabdf750b465 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:44.442669 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d865ef2c-0b3c-46d4-8bd0-fabdf750b465 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:44.443417 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d865ef2c-0b3c-46d4-8bd0-fabdf750b465 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:44.453306 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-06901cef-2c95-4a06-980d-963a9c8ea7e1 req-bcaa29b2-0a08-4cfc-b8b3-36609ec8fe7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1f1412-017f-448b-a6bb-21d09d668a46", "name": "network-vif-plugged", "status": "completed", "tag": "feb9d98a-c1aa-45cf-b1e3-06597d656e69"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:44.474973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-06901cef-2c95-4a06-980d-963a9c8ea7e1 req-bcaa29b2-0a08-4cfc-b8b3-36609ec8fe7f service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:44.477714 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-06901cef-2c95-4a06-980d-963a9c8ea7e1 req-bcaa29b2-0a08-4cfc-b8b3-36609ec8fe7f service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:44.501968 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-06901cef-2c95-4a06-980d-963a9c8ea7e1 req-bcaa29b2-0a08-4cfc-b8b3-36609ec8fe7f service nova] Creating event network-vif-plugged:feb9d98a-c1aa-45cf-b1e3-06597d656e69 for instance ab1f1412-017f-448b-a6bb-21d09d668a46 on hv-cinder-83602 Jun 30 16:37:44.508150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-06901cef-2c95-4a06-980d-963a9c8ea7e1 req-bcaa29b2-0a08-4cfc-b8b3-36609ec8fe7f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062777 Jun 30 16:37:44.509261 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 254/503] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:37:44.821514 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d865ef2c-0b3c-46d4-8bd0-fabdf750b465 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:44.836031 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d865ef2c-0b3c-46d4-8bd0-fabdf750b465 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:44.839768 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d865ef2c-0b3c-46d4-8bd0-fabdf750b465 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:44.841390 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d865ef2c-0b3c-46d4-8bd0-fabdf750b465 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.417624 Jun 30 16:37:44.842475 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 250/504] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:44 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:44.873010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d4991e8b-e7c7-4a5e-8ed0-240cadf0b22f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:44.873840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d4991e8b-e7c7-4a5e-8ed0-240cadf0b22f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:44.882065 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d4991e8b-e7c7-4a5e-8ed0-240cadf0b22f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:44.882972 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d4991e8b-e7c7-4a5e-8ed0-240cadf0b22f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:44.884088 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d4991e8b-e7c7-4a5e-8ed0-240cadf0b22f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:44.884694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d4991e8b-e7c7-4a5e-8ed0-240cadf0b22f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:44.909364 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-34dace9e-3543-4b99-9959-4792a7d9b556 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:44.910280 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-34dace9e-3543-4b99-9959-4792a7d9b556 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:44.963557 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-34dace9e-3543-4b99-9959-4792a7d9b556 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:44.966074 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-34dace9e-3543-4b99-9959-4792a7d9b556 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:44.968163 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-34dace9e-3543-4b99-9959-4792a7d9b556 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:44.970658 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-34dace9e-3543-4b99-9959-4792a7d9b556 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:45.214973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d4991e8b-e7c7-4a5e-8ed0-240cadf0b22f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:45.224760 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d4991e8b-e7c7-4a5e-8ed0-240cadf0b22f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1260 microversion: 2.1 time: 0.357564 Jun 30 16:37:45.227296 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 255/505] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:44 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1260 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:45.487817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-34dace9e-3543-4b99-9959-4792a7d9b556 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lazy-loading 'services' on Instance uuid 285f3262-38a1-4c65-9680-18fa2ef40c32 {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:37:45.636935 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f2f65761-1216-43c5-8ccf-a1fa7bfa96a1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:45.638166 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f2f65761-1216-43c5-8ccf-a1fa7bfa96a1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:45.656885 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f2f65761-1216-43c5-8ccf-a1fa7bfa96a1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:45.657342 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f2f65761-1216-43c5-8ccf-a1fa7bfa96a1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:45.658223 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f2f65761-1216-43c5-8ccf-a1fa7bfa96a1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:45.662345 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f2f65761-1216-43c5-8ccf-a1fa7bfa96a1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:45.698999 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-f2f65761-1216-43c5-8ccf-a1fa7bfa96a1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lazy-loading 'flavor' on Instance uuid d786bea4-1a92-4eaf-8450-f69f05986687 {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:37:45.826227 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-34dace9e-3543-4b99-9959-4792a7d9b556 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-volume_attachments/154a8320-9554-4bad-8822-7dccf82d319d" status: 202 len: 0 microversion: 2.1 time: 0.921508 Jun 30 16:37:45.833347 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 251/506] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 30 16:37:44 2022] DELETE /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-volume_attachments/154a8320-9554-4bad-8822-7dccf82d319d => generated 0 bytes in 924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:37:45.846947 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-55a56ec2-b2d0-4df1-9753-4d03f5aa7bdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:45.850846 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-55a56ec2-b2d0-4df1-9753-4d03f5aa7bdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:45.867284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-55a56ec2-b2d0-4df1-9753-4d03f5aa7bdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:45.868909 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-55a56ec2-b2d0-4df1-9753-4d03f5aa7bdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:45.870348 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-55a56ec2-b2d0-4df1-9753-4d03f5aa7bdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:45.872176 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-55a56ec2-b2d0-4df1-9753-4d03f5aa7bdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:45.924217 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-55a56ec2-b2d0-4df1-9753-4d03f5aa7bdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087112 Jun 30 16:37:45.925589 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 252/507] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:37:45 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:37:45.931839 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3870eaec-476d-4074-8dd6-585cfe3df6dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:45.932540 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3870eaec-476d-4074-8dd6-585cfe3df6dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:45.940128 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3870eaec-476d-4074-8dd6-585cfe3df6dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:45.940841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3870eaec-476d-4074-8dd6-585cfe3df6dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:45.941871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3870eaec-476d-4074-8dd6-585cfe3df6dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:45.942502 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3870eaec-476d-4074-8dd6-585cfe3df6dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:46.145966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3870eaec-476d-4074-8dd6-585cfe3df6dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:46.161577 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3870eaec-476d-4074-8dd6-585cfe3df6dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:46.163302 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3870eaec-476d-4074-8dd6-585cfe3df6dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:46.164559 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3870eaec-476d-4074-8dd6-585cfe3df6dc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.237227 Jun 30 16:37:46.165116 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 253/508] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:45 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:46.254480 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9257cf30-f310-43c1-bdcc-ee7eafcd3ebe tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:46.255443 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9257cf30-f310-43c1-bdcc-ee7eafcd3ebe tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:46.262307 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9257cf30-f310-43c1-bdcc-ee7eafcd3ebe tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:46.263022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9257cf30-f310-43c1-bdcc-ee7eafcd3ebe tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:46.264095 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9257cf30-f310-43c1-bdcc-ee7eafcd3ebe tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:46.264790 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9257cf30-f310-43c1-bdcc-ee7eafcd3ebe tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:46.300735 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f2f65761-1216-43c5-8ccf-a1fa7bfa96a1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "POST /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/action" status: 200 len: 32 microversion: 2.1 time: 0.670384 Jun 30 16:37:46.300735 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 256/509] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 30 16:37:45 2022] POST /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/action => generated 32 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 30 16:37:46.315016 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-378b377b-53f5-44ac-976d-70b3a064e9e1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:46.315773 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-378b377b-53f5-44ac-976d-70b3a064e9e1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:46.317908 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:46.327774 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-378b377b-53f5-44ac-976d-70b3a064e9e1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:46.328230 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-378b377b-53f5-44ac-976d-70b3a064e9e1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:46.329259 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-378b377b-53f5-44ac-976d-70b3a064e9e1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:46.329706 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-378b377b-53f5-44ac-976d-70b3a064e9e1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:46.334419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:46.520004 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9257cf30-f310-43c1-bdcc-ee7eafcd3ebe tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:46.531347 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9257cf30-f310-43c1-bdcc-ee7eafcd3ebe tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1260 microversion: 2.1 time: 0.280887 Jun 30 16:37:46.533364 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 254/510] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:46 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:46.578342 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-378b377b-53f5-44ac-976d-70b3a064e9e1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:46.587006 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-378b377b-53f5-44ac-976d-70b3a064e9e1 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.281614 Jun 30 16:37:46.588178 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 257/511] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:46 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:46.937132 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-67843a0d-211d-45a5-9bc2-bfcc33654da1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:46.938211 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-67843a0d-211d-45a5-9bc2-bfcc33654da1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:46.950431 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-67843a0d-211d-45a5-9bc2-bfcc33654da1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:46.951034 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-67843a0d-211d-45a5-9bc2-bfcc33654da1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:46.956767 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-67843a0d-211d-45a5-9bc2-bfcc33654da1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:46.956767 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-67843a0d-211d-45a5-9bc2-bfcc33654da1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:46.997878 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-67843a0d-211d-45a5-9bc2-bfcc33654da1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065087 Jun 30 16:37:47.003167 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 255/512] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:37:46 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:37:47.186842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ac5b99de-3c73-436b-9076-7d10e6a8204b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:47.187839 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ac5b99de-3c73-436b-9076-7d10e6a8204b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:47.194779 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ac5b99de-3c73-436b-9076-7d10e6a8204b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:47.195319 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ac5b99de-3c73-436b-9076-7d10e6a8204b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:47.196208 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ac5b99de-3c73-436b-9076-7d10e6a8204b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:47.196751 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ac5b99de-3c73-436b-9076-7d10e6a8204b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:47.373632 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ac5b99de-3c73-436b-9076-7d10e6a8204b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:47.382608 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ac5b99de-3c73-436b-9076-7d10e6a8204b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:47.384318 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ac5b99de-3c73-436b-9076-7d10e6a8204b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:47.385493 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ac5b99de-3c73-436b-9076-7d10e6a8204b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.206014 Jun 30 16:37:47.386171 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 258/513] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:47 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:47.552168 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9679f030-8d3a-4a25-bb1b-8e999d386775 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:47.552857 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9679f030-8d3a-4a25-bb1b-8e999d386775 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:47.561808 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9679f030-8d3a-4a25-bb1b-8e999d386775 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:47.562450 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9679f030-8d3a-4a25-bb1b-8e999d386775 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:47.563349 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9679f030-8d3a-4a25-bb1b-8e999d386775 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:47.563884 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9679f030-8d3a-4a25-bb1b-8e999d386775 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:47.608931 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9d8aa8d8-e29b-4b78-b911-dcd45edb59ae tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:47.609878 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9d8aa8d8-e29b-4b78-b911-dcd45edb59ae tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:47.616207 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9d8aa8d8-e29b-4b78-b911-dcd45edb59ae tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:47.616657 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9d8aa8d8-e29b-4b78-b911-dcd45edb59ae tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:47.617687 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9d8aa8d8-e29b-4b78-b911-dcd45edb59ae tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:47.618302 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9d8aa8d8-e29b-4b78-b911-dcd45edb59ae tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:47.850702 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9d8aa8d8-e29b-4b78-b911-dcd45edb59ae tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:47.853019 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9679f030-8d3a-4a25-bb1b-8e999d386775 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:47.865211 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9d8aa8d8-e29b-4b78-b911-dcd45edb59ae tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.261113 Jun 30 16:37:47.865351 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 259/514] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:47 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:47.866160 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9679f030-8d3a-4a25-bb1b-8e999d386775 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1260 microversion: 2.1 time: 0.320511 Jun 30 16:37:47.876678 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 256/515] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:47 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1260 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:48.013856 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e306b27c-def6-4268-b44a-f59b911042b2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:48.015053 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e306b27c-def6-4268-b44a-f59b911042b2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:48.022155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e306b27c-def6-4268-b44a-f59b911042b2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:48.022717 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e306b27c-def6-4268-b44a-f59b911042b2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:48.023992 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e306b27c-def6-4268-b44a-f59b911042b2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:48.024383 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e306b27c-def6-4268-b44a-f59b911042b2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:48.055994 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e306b27c-def6-4268-b44a-f59b911042b2 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049031 Jun 30 16:37:48.056572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 260/516] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:37:48 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:37:48.405476 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1a3b94c5-291f-42bd-9067-1ea064674911 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:48.406089 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-1a3b94c5-291f-42bd-9067-1ea064674911 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:48.412202 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1a3b94c5-291f-42bd-9067-1ea064674911 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:48.412659 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1a3b94c5-291f-42bd-9067-1ea064674911 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:48.413576 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1a3b94c5-291f-42bd-9067-1ea064674911 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:48.414023 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1a3b94c5-291f-42bd-9067-1ea064674911 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:48.571579 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-1a3b94c5-291f-42bd-9067-1ea064674911 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:48.581605 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-1a3b94c5-291f-42bd-9067-1ea064674911 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:48.583144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-1a3b94c5-291f-42bd-9067-1ea064674911 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:48.584655 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-1a3b94c5-291f-42bd-9067-1ea064674911 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.183605 Jun 30 16:37:48.584919 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 257/517] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:48 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:48.884193 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-db96d7f6-7eeb-4561-8659-f09d22ab248b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:48.884704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f47617b4-ad73-4045-a281-8a162b39b14f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:48.885174 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-db96d7f6-7eeb-4561-8659-f09d22ab248b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:48.886161 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f47617b4-ad73-4045-a281-8a162b39b14f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:48.894070 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-db96d7f6-7eeb-4561-8659-f09d22ab248b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:48.894515 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-db96d7f6-7eeb-4561-8659-f09d22ab248b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:48.895286 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-db96d7f6-7eeb-4561-8659-f09d22ab248b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:48.895742 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-db96d7f6-7eeb-4561-8659-f09d22ab248b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:48.903917 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f47617b4-ad73-4045-a281-8a162b39b14f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:48.904783 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f47617b4-ad73-4045-a281-8a162b39b14f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:48.905888 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f47617b4-ad73-4045-a281-8a162b39b14f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:48.906899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f47617b4-ad73-4045-a281-8a162b39b14f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:49.240575 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f47617b4-ad73-4045-a281-8a162b39b14f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:49.252461 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-db96d7f6-7eeb-4561-8659-f09d22ab248b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:49.256299 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f47617b4-ad73-4045-a281-8a162b39b14f tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.375399 Jun 30 16:37:49.257619 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 261/518] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:48 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:49.259964 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-db96d7f6-7eeb-4561-8659-f09d22ab248b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1260 microversion: 2.1 time: 0.379619 Jun 30 16:37:49.262355 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 258/519] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:48 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1260 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:49.267455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2da31152-d10b-43aa-bdea-1e5fee382a8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:49.269168 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d404bb8a-553d-4cf6-99ff-96a505a738b7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:49.269674 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2da31152-d10b-43aa-bdea-1e5fee382a8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:49.276636 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2da31152-d10b-43aa-bdea-1e5fee382a8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:49.277906 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2da31152-d10b-43aa-bdea-1e5fee382a8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:49.278859 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2da31152-d10b-43aa-bdea-1e5fee382a8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:49.279412 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2da31152-d10b-43aa-bdea-1e5fee382a8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:49.281807 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d404bb8a-553d-4cf6-99ff-96a505a738b7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:49.282610 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d404bb8a-553d-4cf6-99ff-96a505a738b7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:49.313522 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2da31152-d10b-43aa-bdea-1e5fee382a8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051928 Jun 30 16:37:49.314225 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 259/520] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:37:49 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:37:49.330798 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d404bb8a-553d-4cf6-99ff-96a505a738b7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Going to try to stop instance {{(pid=124815) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 30 16:37:49.564581 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d404bb8a-553d-4cf6-99ff-96a505a738b7 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "POST /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/action" status: 202 len: 0 microversion: 2.1 time: 0.305037 Jun 30 16:37:49.565346 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 262/521] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 30 16:37:49 2022] POST /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:37:49.573489 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ebd01cac-bc12-4328-bdd4-1db1be251254 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:49.574711 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ebd01cac-bc12-4328-bdd4-1db1be251254 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:49.588407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ebd01cac-bc12-4328-bdd4-1db1be251254 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:49.588866 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ebd01cac-bc12-4328-bdd4-1db1be251254 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:49.589721 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ebd01cac-bc12-4328-bdd4-1db1be251254 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:49.590685 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ebd01cac-bc12-4328-bdd4-1db1be251254 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:49.606581 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-852108be-3e26-4efb-bc98-ecae6f01cc53 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:49.607687 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-852108be-3e26-4efb-bc98-ecae6f01cc53 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:49.615068 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-852108be-3e26-4efb-bc98-ecae6f01cc53 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:49.615925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-852108be-3e26-4efb-bc98-ecae6f01cc53 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:49.616994 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-852108be-3e26-4efb-bc98-ecae6f01cc53 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:49.617630 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-852108be-3e26-4efb-bc98-ecae6f01cc53 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:49.907207 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ebd01cac-bc12-4328-bdd4-1db1be251254 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:49.915458 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ebd01cac-bc12-4328-bdd4-1db1be251254 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1676 microversion: 2.1 time: 0.345864 Jun 30 16:37:49.916174 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 260/522] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:49 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1676 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:49.920911 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1843700540", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "networks": [{"uuid": "cb2d6663-d883-4174-ba6e-c7fc0350bd02"}]}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:49.931068 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-852108be-3e26-4efb-bc98-ecae6f01cc53 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:49.940743 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-852108be-3e26-4efb-bc98-ecae6f01cc53 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:49.942216 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-852108be-3e26-4efb-bc98-ecae6f01cc53 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:49.943376 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-852108be-3e26-4efb-bc98-ecae6f01cc53 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.342119 Jun 30 16:37:49.944010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 263/523] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:49 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:37:49.977823 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.network.neutron [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] validate_networks() for [('cb2d6663-d883-4174-ba6e-c7fc0350bd02', None, None, None, None, None)] {{(pid=124814) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:37:50.276448 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-78b73782-d986-4f3c-b533-8f95deb50550 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:50.277298 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-78b73782-d986-4f3c-b533-8f95deb50550 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:50.283666 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78b73782-d986-4f3c-b533-8f95deb50550 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:50.285567 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78b73782-d986-4f3c-b533-8f95deb50550 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:50.292125 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78b73782-d986-4f3c-b533-8f95deb50550 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:50.292125 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78b73782-d986-4f3c-b533-8f95deb50550 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:50.537657 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Flavor limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:37:50.538092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Image limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:37:50.542273 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Flavor pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:37:50.542273 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Image pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:37:50.542273 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:37:50.545250 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-78b73782-d986-4f3c-b533-8f95deb50550 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:50.545678 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:50.553946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-78b73782-d986-4f3c-b533-8f95deb50550 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.281184 Jun 30 16:37:50.554157 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:50.554843 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 264/524] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:50 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:50.559813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2b93427a-f124-4fc1-89e4-c606ba88fe72 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:50.560676 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2b93427a-f124-4fc1-89e4-c606ba88fe72 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:50.562169 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:50.563901 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:50.564493 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:50.569313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2b93427a-f124-4fc1-89e4-c606ba88fe72 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:50.569764 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2b93427a-f124-4fc1-89e4-c606ba88fe72 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:50.571008 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2b93427a-f124-4fc1-89e4-c606ba88fe72 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:50.571008 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2b93427a-f124-4fc1-89e4-c606ba88fe72 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:50.584461 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Getting quotas for project 4df4c3aa7c8044dcbd46064e0e495a84. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:37:50.589173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Getting quotas for user 96d7af5479ce46b99e333d91128b826e and project 4df4c3aa7c8044dcbd46064e0e495a84. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:37:50.602678 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Going to run 1 instances... {{(pid=124814) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:37:50.614015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:37:50.759144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-4059370f-e43d-4fd1-990e-9d8a1c9e73bc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.841918 Jun 30 16:37:50.760397 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 261/525] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:37:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 16:37:50.765951 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f00d868d-b6ad-46f2-abb2-7568a6de7293 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:50.767335 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f00d868d-b6ad-46f2-abb2-7568a6de7293 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:50.774460 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f00d868d-b6ad-46f2-abb2-7568a6de7293 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:50.774907 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f00d868d-b6ad-46f2-abb2-7568a6de7293 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:50.775912 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f00d868d-b6ad-46f2-abb2-7568a6de7293 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:50.776544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f00d868d-b6ad-46f2-abb2-7568a6de7293 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:50.779726 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:50.815351 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f00d868d-b6ad-46f2-abb2-7568a6de7293 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053701 Jun 30 16:37:50.815951 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 262/526] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:37:50 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 16:37:50.823550 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-e512ad4e-e32e-48a7-bb1c-1c8cab3514f5 req-1d47dafc-c314-4fee-a819-91b8641ed754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d4ed30-dc39-4be8-b345-360410abdc13", "name": "network-vif-plugged", "status": "completed", "tag": "ab01136b-ddb4-42c0-b8a6-880714395a42"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:50.833504 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-e512ad4e-e32e-48a7-bb1c-1c8cab3514f5 req-1d47dafc-c314-4fee-a819-91b8641ed754 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:50.834391 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-e512ad4e-e32e-48a7-bb1c-1c8cab3514f5 req-1d47dafc-c314-4fee-a819-91b8641ed754 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:50.848575 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-e512ad4e-e32e-48a7-bb1c-1c8cab3514f5 req-1d47dafc-c314-4fee-a819-91b8641ed754 service nova] Creating event network-vif-plugged:ab01136b-ddb4-42c0-b8a6-880714395a42 for instance 68d4ed30-dc39-4be8-b345-360410abdc13 on hv-cinder-83602 Jun 30 16:37:50.856711 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-e512ad4e-e32e-48a7-bb1c-1c8cab3514f5 req-1d47dafc-c314-4fee-a819-91b8641ed754 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037373 Jun 30 16:37:50.859530 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 263/527] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:37:50.868800 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5ba69427-94de-40a9-bfae-322bea19b7dd tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:50.871680 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5ba69427-94de-40a9-bfae-322bea19b7dd tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:50.903369 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2b93427a-f124-4fc1-89e4-c606ba88fe72 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:50.928104 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2b93427a-f124-4fc1-89e4-c606ba88fe72 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1260 microversion: 2.1 time: 0.371752 Jun 30 16:37:50.935079 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 265/528] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:50 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1260 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:50.944061 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4eedbaaa-a0d8-40b8-b288-929a6e2ff71d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:50.948230 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4eedbaaa-a0d8-40b8-b288-929a6e2ff71d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:50.963355 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4eedbaaa-a0d8-40b8-b288-929a6e2ff71d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:50.963967 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4eedbaaa-a0d8-40b8-b288-929a6e2ff71d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:50.965321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4eedbaaa-a0d8-40b8-b288-929a6e2ff71d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:50.966030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4eedbaaa-a0d8-40b8-b288-929a6e2ff71d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:51.002614 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4eedbaaa-a0d8-40b8-b288-929a6e2ff71d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Going to try to terminate instance {{(pid=124815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:37:51.013984 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5ba69427-94de-40a9-bfae-322bea19b7dd tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:51.026192 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5ba69427-94de-40a9-bfae-322bea19b7dd tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1219 microversion: 2.1 time: 0.163872 Jun 30 16:37:51.027420 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 264/529] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:50 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:51.033022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-eb8d8b64-127d-4475-b2b5-1cafeed2484c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:51.033997 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-eb8d8b64-127d-4475-b2b5-1cafeed2484c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:51.043904 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eb8d8b64-127d-4475-b2b5-1cafeed2484c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:51.044539 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eb8d8b64-127d-4475-b2b5-1cafeed2484c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:51.045497 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eb8d8b64-127d-4475-b2b5-1cafeed2484c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:51.045992 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eb8d8b64-127d-4475-b2b5-1cafeed2484c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:51.430547 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-4eedbaaa-a0d8-40b8-b288-929a6e2ff71d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 204 len: 0 microversion: 2.1 time: 0.493794 Jun 30 16:37:51.431244 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 266/530] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:37:50 2022] DELETE /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:37:51.439056 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4e53dbd0-5011-45f4-a58b-af33a39b70fb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:51.440182 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4e53dbd0-5011-45f4-a58b-af33a39b70fb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:51.446442 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4e53dbd0-5011-45f4-a58b-af33a39b70fb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:51.447018 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4e53dbd0-5011-45f4-a58b-af33a39b70fb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:51.447909 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4e53dbd0-5011-45f4-a58b-af33a39b70fb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:51.448409 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4e53dbd0-5011-45f4-a58b-af33a39b70fb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:51.608294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-eb8d8b64-127d-4475-b2b5-1cafeed2484c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:51.617170 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-eb8d8b64-127d-4475-b2b5-1cafeed2484c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1676 microversion: 2.1 time: 0.588092 Jun 30 16:37:51.617746 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 265/531] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:51 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1676 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:51.624273 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0886a3e5-1a76-41c8-a5f9-50830b5c47e9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:51.624273 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0886a3e5-1a76-41c8-a5f9-50830b5c47e9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:51.630888 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0886a3e5-1a76-41c8-a5f9-50830b5c47e9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:51.631353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0886a3e5-1a76-41c8-a5f9-50830b5c47e9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:51.632217 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0886a3e5-1a76-41c8-a5f9-50830b5c47e9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:51.632659 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0886a3e5-1a76-41c8-a5f9-50830b5c47e9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:51.656664 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-4e53dbd0-5011-45f4-a58b-af33a39b70fb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:51.666594 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-4e53dbd0-5011-45f4-a58b-af33a39b70fb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:51.672421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-4e53dbd0-5011-45f4-a58b-af33a39b70fb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:51.673644 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-4e53dbd0-5011-45f4-a58b-af33a39b70fb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.239825 Jun 30 16:37:51.674578 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 267/532] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:51 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:37:51.679513 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2e018aa8-8feb-4ddd-83b5-038b1b907403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:51.680454 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2e018aa8-8feb-4ddd-83b5-038b1b907403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:51.688321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2e018aa8-8feb-4ddd-83b5-038b1b907403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:51.689176 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2e018aa8-8feb-4ddd-83b5-038b1b907403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:51.690127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2e018aa8-8feb-4ddd-83b5-038b1b907403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:51.690718 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2e018aa8-8feb-4ddd-83b5-038b1b907403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:51.864421 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0886a3e5-1a76-41c8-a5f9-50830b5c47e9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:51.873793 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0886a3e5-1a76-41c8-a5f9-50830b5c47e9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1681 microversion: 2.1 time: 0.254121 Jun 30 16:37:51.874503 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 266/533] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:51 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1681 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:51.890539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2e018aa8-8feb-4ddd-83b5-038b1b907403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:51.899834 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2e018aa8-8feb-4ddd-83b5-038b1b907403 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.223942 Jun 30 16:37:51.900698 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 268/534] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:51 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:51.953020 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-26973ea5-148a-4a51-a348-ba4bf0a02ac8 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:51.953654 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-26973ea5-148a-4a51-a348-ba4bf0a02ac8 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:51.959577 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-26973ea5-148a-4a51-a348-ba4bf0a02ac8 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:51.960030 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-26973ea5-148a-4a51-a348-ba4bf0a02ac8 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:51.960786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-26973ea5-148a-4a51-a348-ba4bf0a02ac8 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:51.961220 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-26973ea5-148a-4a51-a348-ba4bf0a02ac8 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:52.052216 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-117c334a-e2c7-4b20-a99a-4399ced34b5e tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:52.052831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-117c334a-e2c7-4b20-a99a-4399ced34b5e tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:52.059702 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-117c334a-e2c7-4b20-a99a-4399ced34b5e tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:52.060152 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-117c334a-e2c7-4b20-a99a-4399ced34b5e tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:52.060957 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-117c334a-e2c7-4b20-a99a-4399ced34b5e tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:52.061394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-117c334a-e2c7-4b20-a99a-4399ced34b5e tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:52.138441 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-117c334a-e2c7-4b20-a99a-4399ced34b5e tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:52.141311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-26973ea5-148a-4a51-a348-ba4bf0a02ac8 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:52.147453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-117c334a-e2c7-4b20-a99a-4399ced34b5e tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1223 microversion: 2.1 time: 0.099198 Jun 30 16:37:52.148655 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 269/535] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:52 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:52.151772 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-26973ea5-148a-4a51-a348-ba4bf0a02ac8 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1260 microversion: 2.1 time: 0.203095 Jun 30 16:37:52.154208 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 267/536] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:51 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1260 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:52.635647 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c3c47042-461d-4e62-8178-c2b46c50d9a5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:52.636153 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c3c47042-461d-4e62-8178-c2b46c50d9a5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:52.643215 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3c47042-461d-4e62-8178-c2b46c50d9a5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:52.643707 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3c47042-461d-4e62-8178-c2b46c50d9a5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:52.644511 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3c47042-461d-4e62-8178-c2b46c50d9a5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:52.644936 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3c47042-461d-4e62-8178-c2b46c50d9a5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:52.694193 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8eab3e75-4464-4d2c-a8c6-8a062b90f68e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:52.694844 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8eab3e75-4464-4d2c-a8c6-8a062b90f68e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:52.704599 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8eab3e75-4464-4d2c-a8c6-8a062b90f68e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:52.705051 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8eab3e75-4464-4d2c-a8c6-8a062b90f68e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:52.706182 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8eab3e75-4464-4d2c-a8c6-8a062b90f68e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:52.706635 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8eab3e75-4464-4d2c-a8c6-8a062b90f68e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:52.847741 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c3c47042-461d-4e62-8178-c2b46c50d9a5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:52.857774 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c3c47042-461d-4e62-8178-c2b46c50d9a5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1676 microversion: 2.1 time: 0.226075 Jun 30 16:37:52.868553 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 270/537] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:52 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:52.888871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8eab3e75-4464-4d2c-a8c6-8a062b90f68e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:52.895096 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2bd82f2e-6b4b-4911-9cc2-3789cd79ef1a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:52.896832 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2bd82f2e-6b4b-4911-9cc2-3789cd79ef1a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:52.898302 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8eab3e75-4464-4d2c-a8c6-8a062b90f68e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:52.899864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8eab3e75-4464-4d2c-a8c6-8a062b90f68e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:52.901056 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8eab3e75-4464-4d2c-a8c6-8a062b90f68e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1808 microversion: 2.20 time: 0.211488 Jun 30 16:37:52.901614 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 268/538] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:52 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:37:52.902821 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2bd82f2e-6b4b-4911-9cc2-3789cd79ef1a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:52.903308 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2bd82f2e-6b4b-4911-9cc2-3789cd79ef1a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:52.904146 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2bd82f2e-6b4b-4911-9cc2-3789cd79ef1a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:52.904582 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2bd82f2e-6b4b-4911-9cc2-3789cd79ef1a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:52.907395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:52.917901 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-15ac65b9-cced-4d5e-99ac-9a0fd35f09e9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:52.918567 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-15ac65b9-cced-4d5e-99ac-9a0fd35f09e9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:52.931319 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-15ac65b9-cced-4d5e-99ac-9a0fd35f09e9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:52.931319 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-15ac65b9-cced-4d5e-99ac-9a0fd35f09e9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:52.931319 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-15ac65b9-cced-4d5e-99ac-9a0fd35f09e9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:52.931319 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-15ac65b9-cced-4d5e-99ac-9a0fd35f09e9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:53.137412 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2bd82f2e-6b4b-4911-9cc2-3789cd79ef1a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:53.144974 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2bd82f2e-6b4b-4911-9cc2-3789cd79ef1a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1681 microversion: 2.1 time: 0.253607 Jun 30 16:37:53.145668 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 271/539] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:52 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1681 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:53.165842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a759ee14-8cc8-44d5-b287-e89f8ec6ff3a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:53.166739 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a759ee14-8cc8-44d5-b287-e89f8ec6ff3a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:53.173222 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-15ac65b9-cced-4d5e-99ac-9a0fd35f09e9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:53.175952 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a759ee14-8cc8-44d5-b287-e89f8ec6ff3a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:53.176525 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a759ee14-8cc8-44d5-b287-e89f8ec6ff3a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:53.177429 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a759ee14-8cc8-44d5-b287-e89f8ec6ff3a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:53.177968 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a759ee14-8cc8-44d5-b287-e89f8ec6ff3a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:53.182300 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-15ac65b9-cced-4d5e-99ac-9a0fd35f09e9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.268080 Jun 30 16:37:53.182929 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 269/540] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:52 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:53.198137 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2671517c-37bb-4f01-8855-8846936cf922 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:53.198864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2671517c-37bb-4f01-8855-8846936cf922 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:53.211168 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2671517c-37bb-4f01-8855-8846936cf922 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:53.211533 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2671517c-37bb-4f01-8855-8846936cf922 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:53.212310 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2671517c-37bb-4f01-8855-8846936cf922 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:53.212744 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2671517c-37bb-4f01-8855-8846936cf922 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:53.257003 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a759ee14-8cc8-44d5-b287-e89f8ec6ff3a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:53.265680 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a759ee14-8cc8-44d5-b287-e89f8ec6ff3a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1223 microversion: 2.1 time: 0.103687 Jun 30 16:37:53.266269 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 272/541] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:53 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:53.364617 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2671517c-37bb-4f01-8855-8846936cf922 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:53.372816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2671517c-37bb-4f01-8855-8846936cf922 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1260 microversion: 2.1 time: 0.188723 Jun 30 16:37:53.373724 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 270/542] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:53 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:53.875697 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-604f59b1-5c01-4400-8201-f6e3c6cd7fb4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:53.876299 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-604f59b1-5c01-4400-8201-f6e3c6cd7fb4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:53.884366 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-604f59b1-5c01-4400-8201-f6e3c6cd7fb4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:53.884844 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-604f59b1-5c01-4400-8201-f6e3c6cd7fb4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:53.885976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-604f59b1-5c01-4400-8201-f6e3c6cd7fb4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:53.886525 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-604f59b1-5c01-4400-8201-f6e3c6cd7fb4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:53.920992 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a3637fdd-a716-47f8-bde6-17de38ee924d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:53.921632 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a3637fdd-a716-47f8-bde6-17de38ee924d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:53.929117 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a3637fdd-a716-47f8-bde6-17de38ee924d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:53.929561 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a3637fdd-a716-47f8-bde6-17de38ee924d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:53.930373 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a3637fdd-a716-47f8-bde6-17de38ee924d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:53.930799 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a3637fdd-a716-47f8-bde6-17de38ee924d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:54.083001 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-604f59b1-5c01-4400-8201-f6e3c6cd7fb4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:54.090865 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-604f59b1-5c01-4400-8201-f6e3c6cd7fb4 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1676 microversion: 2.1 time: 0.219292 Jun 30 16:37:54.091445 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 273/543] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:53 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1676 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:54.112369 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a3637fdd-a716-47f8-bde6-17de38ee924d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:54.121115 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a3637fdd-a716-47f8-bde6-17de38ee924d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:54.123205 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a3637fdd-a716-47f8-bde6-17de38ee924d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:54.124611 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a3637fdd-a716-47f8-bde6-17de38ee924d tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1795 microversion: 2.20 time: 0.209099 Jun 30 16:37:54.125170 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 271/544] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:37:53 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1795 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:37:54.162449 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-cc3dcda4-d952-48e0-9be9-515d55bc97af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:54.162983 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-cc3dcda4-d952-48e0-9be9-515d55bc97af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:54.169435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cc3dcda4-d952-48e0-9be9-515d55bc97af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:54.169812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cc3dcda4-d952-48e0-9be9-515d55bc97af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:54.170587 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cc3dcda4-d952-48e0-9be9-515d55bc97af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:54.171085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cc3dcda4-d952-48e0-9be9-515d55bc97af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:54.202637 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e1c9e0fb-d019-4c24-a5a5-bc064b2a5daf tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:54.203351 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e1c9e0fb-d019-4c24-a5a5-bc064b2a5daf tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:54.209802 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1c9e0fb-d019-4c24-a5a5-bc064b2a5daf tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:54.210262 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1c9e0fb-d019-4c24-a5a5-bc064b2a5daf tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:54.211246 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1c9e0fb-d019-4c24-a5a5-bc064b2a5daf tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:54.211712 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1c9e0fb-d019-4c24-a5a5-bc064b2a5daf tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:54.406873 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-cc3dcda4-d952-48e0-9be9-515d55bc97af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:54.414415 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-cc3dcda4-d952-48e0-9be9-515d55bc97af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1681 microversion: 2.1 time: 0.255914 Jun 30 16:37:54.414927 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 274/545] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:54 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1681 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:54.420101 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-042379d8-5020-44bb-bdad-0900acd3d55a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:54.420821 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-042379d8-5020-44bb-bdad-0900acd3d55a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:54.426960 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-042379d8-5020-44bb-bdad-0900acd3d55a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:54.427414 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-042379d8-5020-44bb-bdad-0900acd3d55a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:54.428217 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-042379d8-5020-44bb-bdad-0900acd3d55a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:54.428663 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-042379d8-5020-44bb-bdad-0900acd3d55a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:54.440136 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-e1c9e0fb-d019-4c24-a5a5-bc064b2a5daf tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:54.451252 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e1c9e0fb-d019-4c24-a5a5-bc064b2a5daf tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.252861 Jun 30 16:37:54.451975 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 272/546] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:54 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:54.457030 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-68d6fc1a-2729-4935-bd08-510bf2493d35 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:54.457253 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-68d6fc1a-2729-4935-bd08-510bf2493d35 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:54.463287 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-68d6fc1a-2729-4935-bd08-510bf2493d35 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:54.463857 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-68d6fc1a-2729-4935-bd08-510bf2493d35 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:54.464829 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-68d6fc1a-2729-4935-bd08-510bf2493d35 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:54.465203 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-68d6fc1a-2729-4935-bd08-510bf2493d35 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:54.495797 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-042379d8-5020-44bb-bdad-0900acd3d55a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:54.504273 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-042379d8-5020-44bb-bdad-0900acd3d55a tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1215 microversion: 2.1 time: 0.088305 Jun 30 16:37:54.505091 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 275/547] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:54 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:54.706701 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-68d6fc1a-2729-4935-bd08-510bf2493d35 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:54.715348 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-68d6fc1a-2729-4935-bd08-510bf2493d35 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1260 microversion: 2.1 time: 0.262058 Jun 30 16:37:54.720750 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 273/548] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:54 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:55.111759 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a2afa41f-3bf4-4908-90a1-a06ea6574510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:55.112597 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a2afa41f-3bf4-4908-90a1-a06ea6574510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:55.121119 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a2afa41f-3bf4-4908-90a1-a06ea6574510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:55.121576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a2afa41f-3bf4-4908-90a1-a06ea6574510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:55.122374 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a2afa41f-3bf4-4908-90a1-a06ea6574510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:55.122813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a2afa41f-3bf4-4908-90a1-a06ea6574510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:55.271903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a2afa41f-3bf4-4908-90a1-a06ea6574510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:55.281054 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a2afa41f-3bf4-4908-90a1-a06ea6574510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1676 microversion: 2.1 time: 0.176261 Jun 30 16:37:55.281648 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 276/549] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:55 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:55.436522 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-71774f0b-a917-4183-a9f2-07de95bf1036 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:55.437157 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-71774f0b-a917-4183-a9f2-07de95bf1036 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:55.446252 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-71774f0b-a917-4183-a9f2-07de95bf1036 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:55.451981 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-71774f0b-a917-4183-a9f2-07de95bf1036 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:55.451981 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-71774f0b-a917-4183-a9f2-07de95bf1036 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:55.451981 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-71774f0b-a917-4183-a9f2-07de95bf1036 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:55.469629 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ff174c55-e829-4f5d-9732-93714ec7cb2a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:55.470491 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ff174c55-e829-4f5d-9732-93714ec7cb2a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:55.477185 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ff174c55-e829-4f5d-9732-93714ec7cb2a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:55.477936 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ff174c55-e829-4f5d-9732-93714ec7cb2a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:55.478779 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ff174c55-e829-4f5d-9732-93714ec7cb2a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:55.479481 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ff174c55-e829-4f5d-9732-93714ec7cb2a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:55.597205 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-71774f0b-a917-4183-a9f2-07de95bf1036 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:55.605412 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-71774f0b-a917-4183-a9f2-07de95bf1036 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1614 microversion: 2.1 time: 0.174873 Jun 30 16:37:55.615399 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 274/550] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:55 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1614 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:55.615399 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3cbf17a7-54e8-4fd4-9a2f-2972c5313dcc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:55.615399 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3cbf17a7-54e8-4fd4-9a2f-2972c5313dcc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:55.617753 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3cbf17a7-54e8-4fd4-9a2f-2972c5313dcc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:55.618198 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3cbf17a7-54e8-4fd4-9a2f-2972c5313dcc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:55.618975 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3cbf17a7-54e8-4fd4-9a2f-2972c5313dcc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:55.619402 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3cbf17a7-54e8-4fd4-9a2f-2972c5313dcc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:55.750087 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3cbf17a7-54e8-4fd4-9a2f-2972c5313dcc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:55.759872 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3cbf17a7-54e8-4fd4-9a2f-2972c5313dcc tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1271 microversion: 2.1 time: 0.152674 Jun 30 16:37:55.760867 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 275/551] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:55 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1271 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:55.766512 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f8b2ed55-1b64-4657-9e42-8957dd209f07 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:55.767118 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f8b2ed55-1b64-4657-9e42-8957dd209f07 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:55.790536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f8b2ed55-1b64-4657-9e42-8957dd209f07 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:55.790806 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f8b2ed55-1b64-4657-9e42-8957dd209f07 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:55.791384 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f8b2ed55-1b64-4657-9e42-8957dd209f07 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:55.791846 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f8b2ed55-1b64-4657-9e42-8957dd209f07 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:55.831994 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ff174c55-e829-4f5d-9732-93714ec7cb2a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:55.848220 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ff174c55-e829-4f5d-9732-93714ec7cb2a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.383026 Jun 30 16:37:55.849432 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 277/552] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:55 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:55.861695 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-83ccd6c8-de3c-4810-b74c-6d550138e05a req-c4dd4850-5561-43e7-8a7d-30f9d88f3c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "285f3262-38a1-4c65-9680-18fa2ef40c32", "name": "network-vif-deleted", "tag": "14804ed0-cd51-4355-ba1e-12c6728c4b2f"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:55.896895 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-83ccd6c8-de3c-4810-b74c-6d550138e05a req-c4dd4850-5561-43e7-8a7d-30f9d88f3c14 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:55.897476 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-83ccd6c8-de3c-4810-b74c-6d550138e05a req-c4dd4850-5561-43e7-8a7d-30f9d88f3c14 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:55.911147 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-83ccd6c8-de3c-4810-b74c-6d550138e05a req-c4dd4850-5561-43e7-8a7d-30f9d88f3c14 service nova] Creating event network-vif-deleted:14804ed0-cd51-4355-ba1e-12c6728c4b2f for instance 285f3262-38a1-4c65-9680-18fa2ef40c32 on hv-cinder-83602 Jun 30 16:37:55.918274 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-83ccd6c8-de3c-4810-b74c-6d550138e05a req-c4dd4850-5561-43e7-8a7d-30f9d88f3c14 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067546 Jun 30 16:37:55.919926 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 278/553] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:37:55.965536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f8b2ed55-1b64-4657-9e42-8957dd209f07 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:55.974025 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f8b2ed55-1b64-4657-9e42-8957dd209f07 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1444 microversion: 2.1 time: 0.212382 Jun 30 16:37:55.974599 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 276/554] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:55 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1444 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:55.991870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ad73290b-3a0c-4eef-b159-625642c4e186 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:55.992704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ad73290b-3a0c-4eef-b159-625642c4e186 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:56.000315 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ad73290b-3a0c-4eef-b159-625642c4e186 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:56.001148 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ad73290b-3a0c-4eef-b159-625642c4e186 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:56.002245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ad73290b-3a0c-4eef-b159-625642c4e186 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:56.002905 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ad73290b-3a0c-4eef-b159-625642c4e186 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:56.246579 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ad73290b-3a0c-4eef-b159-625642c4e186 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:56.255218 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ad73290b-3a0c-4eef-b159-625642c4e186 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1444 microversion: 2.1 time: 0.267529 Jun 30 16:37:56.255828 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 279/555] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:55 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1444 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:56.307929 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6afc0b2c-71d9-41e7-89eb-ca78b2bb00ce tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:56.308837 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6afc0b2c-71d9-41e7-89eb-ca78b2bb00ce tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:56.323129 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6afc0b2c-71d9-41e7-89eb-ca78b2bb00ce tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:56.325558 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6afc0b2c-71d9-41e7-89eb-ca78b2bb00ce tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:56.326788 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6afc0b2c-71d9-41e7-89eb-ca78b2bb00ce tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:56.328518 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6afc0b2c-71d9-41e7-89eb-ca78b2bb00ce tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:56.561617 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6afc0b2c-71d9-41e7-89eb-ca78b2bb00ce tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:56.571735 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6afc0b2c-71d9-41e7-89eb-ca78b2bb00ce tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1676 microversion: 2.1 time: 0.267590 Jun 30 16:37:56.577372 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 277/556] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:56 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1676 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:56.622439 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-75408d34-1c18-4b77-a7d0-a76203ae2a72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:56.622997 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-75408d34-1c18-4b77-a7d0-a76203ae2a72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:56.629505 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-75408d34-1c18-4b77-a7d0-a76203ae2a72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:56.629918 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-75408d34-1c18-4b77-a7d0-a76203ae2a72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:56.630707 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-75408d34-1c18-4b77-a7d0-a76203ae2a72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:56.631152 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-75408d34-1c18-4b77-a7d0-a76203ae2a72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:56.677809 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-75408d34-1c18-4b77-a7d0-a76203ae2a72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:56.678561 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-75408d34-1c18-4b77-a7d0-a76203ae2a72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:56.679827 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-75408d34-1c18-4b77-a7d0-a76203ae2a72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lazy-loading 'fault' on Instance uuid 285f3262-38a1-4c65-9680-18fa2ef40c32 {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:37:56.742486 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-75408d34-1c18-4b77-a7d0-a76203ae2a72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:56.752635 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-75408d34-1c18-4b77-a7d0-a76203ae2a72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 200 len: 1332 microversion: 2.1 time: 0.134191 Jun 30 16:37:56.753427 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 280/557] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:56 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 1332 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:56.778220 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-86fe9cad-1e17-40da-a54a-5dc0a4abb5f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:56.780034 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-86fe9cad-1e17-40da-a54a-5dc0a4abb5f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:56.787848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-86fe9cad-1e17-40da-a54a-5dc0a4abb5f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:56.789194 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-86fe9cad-1e17-40da-a54a-5dc0a4abb5f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:56.790514 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-86fe9cad-1e17-40da-a54a-5dc0a4abb5f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:56.791998 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-86fe9cad-1e17-40da-a54a-5dc0a4abb5f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:56.866527 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9b2f0b60-7613-4228-9c96-4dc955f2536a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:56.867456 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9b2f0b60-7613-4228-9c96-4dc955f2536a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:56.888327 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9b2f0b60-7613-4228-9c96-4dc955f2536a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:56.888835 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9b2f0b60-7613-4228-9c96-4dc955f2536a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:56.890086 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9b2f0b60-7613-4228-9c96-4dc955f2536a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:56.890766 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9b2f0b60-7613-4228-9c96-4dc955f2536a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:56.912359 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-86fe9cad-1e17-40da-a54a-5dc0a4abb5f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:56.924476 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-86fe9cad-1e17-40da-a54a-5dc0a4abb5f4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1277 microversion: 2.1 time: 0.150378 Jun 30 16:37:56.925377 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 278/558] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:56 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1277 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:57.416624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9b2f0b60-7613-4228-9c96-4dc955f2536a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:57.425788 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9b2f0b60-7613-4228-9c96-4dc955f2536a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.563756 Jun 30 16:37:57.426812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 281/559] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:56 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:37:57.595069 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-918eba2a-d626-4cbd-8a0e-1e856bcd4857 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:57.596637 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-918eba2a-d626-4cbd-8a0e-1e856bcd4857 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:57.603586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-918eba2a-d626-4cbd-8a0e-1e856bcd4857 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:57.604166 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-918eba2a-d626-4cbd-8a0e-1e856bcd4857 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:57.605231 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-918eba2a-d626-4cbd-8a0e-1e856bcd4857 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:57.605781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-918eba2a-d626-4cbd-8a0e-1e856bcd4857 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:57.770288 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8473d2c8-8efd-4935-854b-c10dfd7cdc58 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:57.771077 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8473d2c8-8efd-4935-854b-c10dfd7cdc58 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:57.777874 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8473d2c8-8efd-4935-854b-c10dfd7cdc58 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:57.780067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8473d2c8-8efd-4935-854b-c10dfd7cdc58 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:57.780067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8473d2c8-8efd-4935-854b-c10dfd7cdc58 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:57.780067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8473d2c8-8efd-4935-854b-c10dfd7cdc58 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:57.796436 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-8473d2c8-8efd-4935-854b-c10dfd7cdc58 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] HTTP exception thrown: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:37:57.797929 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-918eba2a-d626-4cbd-8a0e-1e856bcd4857 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8473d2c8-8efd-4935-854b-c10dfd7cdc58 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Request method failure captured: Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 HTTP/1.1 Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdByCRmKHFn3MWHXG9FHLumdqoFbcitofz3WTo4vIsqDgEdQTbCYdYkG6VrKJfwKSwNBul_mR6Pq6q8wsCNMbsOQVU-vBawcL74Th9xNCcWYhdHHThpX8bYg_ks1_lfyxu2cd7ltcDmgXQzda0-vc83XxV9QJd6mMtTnGfzh1bTh8BQ Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:37:57.798090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:37:57.805976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f942ab31bafc428bb1fba94aee2e0c32"}]}] Jun 30 16:37:57.805976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:37:57.805976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:37:57.805976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:37:57.805976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:37:57.805976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:37:57.805976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:37:57.805976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 0a26028451b345968fe86774f44736dd Jun 30 16:37:57.805976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:37:57.805976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:37:57.805976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:37:57.805976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': '285f3262-38a1-4c65-9680-18fa2ef40c32'} Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:37:57.807000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:37:57.808607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:37:57.810571 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8473d2c8-8efd-4935-854b-c10dfd7cdc58 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Returning 404 to user: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:37:57.810571 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8473d2c8-8efd-4935-854b-c10dfd7cdc58 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 404 len: 111 microversion: 2.1 time: 0.033218 Jun 30 16:37:57.810571 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 282/560] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:57 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:37:57.810571 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b8046840-d5ef-4d06-9a4c-1f0caca4d8e7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '.version_select at 0x7f38201fc0d0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:57.821202 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-918eba2a-d626-4cbd-8a0e-1e856bcd4857 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1676 microversion: 2.1 time: 0.231337 Jun 30 16:37:57.821912 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 279/561] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:57 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1676 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:57.944571 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-152a2766-6074-464a-80a7-caae3c0fb119 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:57.945995 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-152a2766-6074-464a-80a7-caae3c0fb119 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:57.952790 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-152a2766-6074-464a-80a7-caae3c0fb119 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:57.953305 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-152a2766-6074-464a-80a7-caae3c0fb119 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:57.954920 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-152a2766-6074-464a-80a7-caae3c0fb119 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:57.955817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-152a2766-6074-464a-80a7-caae3c0fb119 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:57.958158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b8046840-d5ef-4d06-9a4c-1f0caca4d8e7 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900934417" status: 202 len: 0 microversion: 2.1 time: 0.152665 Jun 30 16:37:57.958801 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 283/562] 10.222.0.67 () {58 vars in 1220 bytes} [Thu Jun 30 16:37:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900934417 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 16:37:57.978543 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=100 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:37:58.300680 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-152a2766-6074-464a-80a7-caae3c0fb119 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:58.308389 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-152a2766-6074-464a-80a7-caae3c0fb119 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1319 microversion: 2.1 time: 0.368603 Jun 30 16:37:58.308961 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 280/563] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:57 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:58.445477 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0a62f6ba-2743-44b5-8814-e19e424e62e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:58.446295 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-0a62f6ba-2743-44b5-8814-e19e424e62e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:58.454564 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0a62f6ba-2743-44b5-8814-e19e424e62e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:58.459565 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0a62f6ba-2743-44b5-8814-e19e424e62e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:58.459565 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0a62f6ba-2743-44b5-8814-e19e424e62e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:58.459565 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0a62f6ba-2743-44b5-8814-e19e424e62e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:58.639865 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-0a62f6ba-2743-44b5-8814-e19e424e62e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:58.643786 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-0a62f6ba-2743-44b5-8814-e19e424e62e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.202823 Jun 30 16:37:58.644756 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 284/564] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:58 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:58.838740 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-b9d49c0e-1446-48f9-a534-3425b4e1fc13 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:58.840515 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-b9d49c0e-1446-48f9-a534-3425b4e1fc13 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:58.848833 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b9d49c0e-1446-48f9-a534-3425b4e1fc13 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:58.850179 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b9d49c0e-1446-48f9-a534-3425b4e1fc13 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:58.851174 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b9d49c0e-1446-48f9-a534-3425b4e1fc13 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:58.851869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b9d49c0e-1446-48f9-a534-3425b4e1fc13 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:59.053598 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-4d5ad6ee-9b0f-4fb9-9380-fbe6f70cee46 req-ec49dc43-a71d-4c25-85c6-25933b925161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b", "tag": "a8b6c930-9dd0-4e31-b6d2-939648afc8ba"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:59.055566 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b9d49c0e-1446-48f9-a534-3425b4e1fc13 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:59.065377 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-4d5ad6ee-9b0f-4fb9-9380-fbe6f70cee46 req-ec49dc43-a71d-4c25-85c6-25933b925161 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:59.065959 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-4d5ad6ee-9b0f-4fb9-9380-fbe6f70cee46 req-ec49dc43-a71d-4c25-85c6-25933b925161 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:59.078964 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-b9d49c0e-1446-48f9-a534-3425b4e1fc13 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1676 microversion: 2.1 time: 0.244428 Jun 30 16:37:59.079899 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 281/565] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:58 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1676 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:59.082023 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-4d5ad6ee-9b0f-4fb9-9380-fbe6f70cee46 req-ec49dc43-a71d-4c25-85c6-25933b925161 service nova] Creating event network-changed:a8b6c930-9dd0-4e31-b6d2-939648afc8ba for instance 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b on hv-cinder-83602 Jun 30 16:37:59.085930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-4d5ad6ee-9b0f-4fb9-9380-fbe6f70cee46 req-ec49dc43-a71d-4c25-85c6-25933b925161 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044963 Jun 30 16:37:59.086526 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 285/566] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:37:59.325915 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-168d6060-57cd-43ef-9b6e-312afa79324d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:59.326840 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-168d6060-57cd-43ef-9b6e-312afa79324d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:59.333679 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-168d6060-57cd-43ef-9b6e-312afa79324d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:59.334361 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-168d6060-57cd-43ef-9b6e-312afa79324d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:59.335316 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-168d6060-57cd-43ef-9b6e-312afa79324d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:59.342215 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-168d6060-57cd-43ef-9b6e-312afa79324d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:59.447425 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-7a59ff38-530d-4f3d-8125-2802fe1013e5 req-3239231b-a3ba-4731-b08c-0db9dfa1b63d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d4ed30-dc39-4be8-b345-360410abdc13", "tag": "ab01136b-ddb4-42c0-b8a6-880714395a42"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:59.456910 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-7a59ff38-530d-4f3d-8125-2802fe1013e5 req-3239231b-a3ba-4731-b08c-0db9dfa1b63d service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:59.457742 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-7a59ff38-530d-4f3d-8125-2802fe1013e5 req-3239231b-a3ba-4731-b08c-0db9dfa1b63d service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:59.474412 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-7a59ff38-530d-4f3d-8125-2802fe1013e5 req-3239231b-a3ba-4731-b08c-0db9dfa1b63d service nova] Creating event network-changed:ab01136b-ddb4-42c0-b8a6-880714395a42 for instance 68d4ed30-dc39-4be8-b345-360410abdc13 on hv-cinder-83602 Jun 30 16:37:59.480678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-7a59ff38-530d-4f3d-8125-2802fe1013e5 req-3239231b-a3ba-4731-b08c-0db9dfa1b63d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037733 Jun 30 16:37:59.481525 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 286/567] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:37:59.532702 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-711ec3f0-c449-44c1-809d-a19b44a4f6b8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Action: 'create', calling method: .version_select at 0x7f382047b8b0>, body: {"keypair": {"name": "tempest-keypair-1022148847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKS0MX+HUzfknNWGuvd+0AiF40SPbQPs+6uaiZ9hci/E7U+gfbDY/0V89+WLkP304vArLbHR5/R1b4TYG0tCZArw7bDTSZMzmBTJ89Q4/Z7PIYwaXQG4J8sC94gqowVnjQ=="}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:37:59.553143 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-711ec3f0-c449-44c1-809d-a19b44a4f6b8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'key_pairs'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:37:59.558960 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-711ec3f0-c449-44c1-809d-a19b44a4f6b8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for user 0a26028451b345968fe86774f44736dd and project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'key_pairs'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:37:59.565152 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-168d6060-57cd-43ef-9b6e-312afa79324d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:37:59.577300 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-168d6060-57cd-43ef-9b6e-312afa79324d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1319 microversion: 2.1 time: 0.252044 Jun 30 16:37:59.578749 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 282/568] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:59 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:37:59.665674 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e349d28e-b9d2-4fec-9a08-039686bae228 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:37:59.666635 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e349d28e-b9d2-4fec-9a08-039686bae228 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:37:59.674103 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e349d28e-b9d2-4fec-9a08-039686bae228 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:59.674950 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e349d28e-b9d2-4fec-9a08-039686bae228 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:59.675985 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e349d28e-b9d2-4fec-9a08-039686bae228 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:37:59.677081 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e349d28e-b9d2-4fec-9a08-039686bae228 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:37:59.686067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-711ec3f0-c449-44c1-809d-a19b44a4f6b8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158247 Jun 30 16:37:59.686758 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 287/569] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 30 16:37:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:38:00.069771 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-e349d28e-b9d2-4fec-9a08-039686bae228 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:00.079828 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e349d28e-b9d2-4fec-9a08-039686bae228 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.420944 Jun 30 16:38:00.080626 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 283/570] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:37:59 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:38:00.097023 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-cbac8f15-e210-481a-8e35-338a09d0ce91 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:00.098447 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-cbac8f15-e210-481a-8e35-338a09d0ce91 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:00.105026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cbac8f15-e210-481a-8e35-338a09d0ce91 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:00.105485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cbac8f15-e210-481a-8e35-338a09d0ce91 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:00.106272 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cbac8f15-e210-481a-8e35-338a09d0ce91 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:00.106716 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cbac8f15-e210-481a-8e35-338a09d0ce91 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:00.293938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-cbac8f15-e210-481a-8e35-338a09d0ce91 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:00.302773 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-cbac8f15-e210-481a-8e35-338a09d0ce91 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1676 microversion: 2.1 time: 0.209507 Jun 30 16:38:00.303631 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 288/571] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:00 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1676 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:00.596176 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-dfbf784f-01d8-4ad3-8e42-ed0c0a63d6e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:00.596793 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-dfbf784f-01d8-4ad3-8e42-ed0c0a63d6e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:00.598598 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=2 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:00.603656 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dfbf784f-01d8-4ad3-8e42-ed0c0a63d6e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:00.604117 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dfbf784f-01d8-4ad3-8e42-ed0c0a63d6e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:00.604872 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dfbf784f-01d8-4ad3-8e42-ed0c0a63d6e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:00.605305 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dfbf784f-01d8-4ad3-8e42-ed0c0a63d6e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:00.751585 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-dfbf784f-01d8-4ad3-8e42-ed0c0a63d6e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:00.759256 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-dfbf784f-01d8-4ad3-8e42-ed0c0a63d6e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1319 microversion: 2.1 time: 0.167549 Jun 30 16:38:00.759892 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 284/572] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:00 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:01.098049 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d4541a9f-07e1-4381-8a5a-a9dd7c8d7f32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:01.099293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d4541a9f-07e1-4381-8a5a-a9dd7c8d7f32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:01.106483 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d4541a9f-07e1-4381-8a5a-a9dd7c8d7f32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:01.107625 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d4541a9f-07e1-4381-8a5a-a9dd7c8d7f32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:01.108980 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d4541a9f-07e1-4381-8a5a-a9dd7c8d7f32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:01.109598 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d4541a9f-07e1-4381-8a5a-a9dd7c8d7f32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:01.323533 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d4541a9f-07e1-4381-8a5a-a9dd7c8d7f32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:01.331909 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8425975c-fcc0-4e42-ad13-80bde06ab30d tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:01.332592 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8425975c-fcc0-4e42-ad13-80bde06ab30d tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:01.334147 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d4541a9f-07e1-4381-8a5a-a9dd7c8d7f32 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.240090 Jun 30 16:38:01.335380 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=12 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:01.337331 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 289/573] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:01 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:01.342586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8425975c-fcc0-4e42-ad13-80bde06ab30d tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:01.343095 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8425975c-fcc0-4e42-ad13-80bde06ab30d tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:01.344067 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8425975c-fcc0-4e42-ad13-80bde06ab30d tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:01.344601 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8425975c-fcc0-4e42-ad13-80bde06ab30d tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:01.514610 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8425975c-fcc0-4e42-ad13-80bde06ab30d tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:01.522332 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8425975c-fcc0-4e42-ad13-80bde06ab30d tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1676 microversion: 2.1 time: 0.199453 Jun 30 16:38:01.522922 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 285/574] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:01 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1676 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:01.777314 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-94f5336c-337e-4170-9506-1980847cb933 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:01.777928 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-94f5336c-337e-4170-9506-1980847cb933 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:01.784953 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94f5336c-337e-4170-9506-1980847cb933 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:01.785400 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94f5336c-337e-4170-9506-1980847cb933 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:01.793860 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94f5336c-337e-4170-9506-1980847cb933 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:01.793860 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94f5336c-337e-4170-9506-1980847cb933 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:01.919346 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-94f5336c-337e-4170-9506-1980847cb933 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:01.927903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-94f5336c-337e-4170-9506-1980847cb933 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1319 microversion: 2.1 time: 0.154471 Jun 30 16:38:01.928479 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 290/575] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:01 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:02.361657 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-52c09297-809c-4494-971c-6d3bcc26f51b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:02.362556 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-52c09297-809c-4494-971c-6d3bcc26f51b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:02.369863 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-52c09297-809c-4494-971c-6d3bcc26f51b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:02.370318 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-52c09297-809c-4494-971c-6d3bcc26f51b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:02.371188 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-52c09297-809c-4494-971c-6d3bcc26f51b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:02.371852 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-52c09297-809c-4494-971c-6d3bcc26f51b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:02.442424 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1723262209", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16892394-e408-48ab-985b-412d1c45e5c5"}], "security_groups": [{"name": "tempest-securitygroup--1215444084"}], "key_name": "tempest-keypair-1022148847", "user_data": "}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:02.531674 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-52c09297-809c-4494-971c-6d3bcc26f51b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:02.540730 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-52c09297-809c-4494-971c-6d3bcc26f51b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.184223 Jun 30 16:38:02.541512 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 286/576] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:02 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:02.547113 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7b86bbba-86ff-47f8-9e86-8b27fa3be83a tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:02.548035 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7b86bbba-86ff-47f8-9e86-8b27fa3be83a tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:02.554892 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b86bbba-86ff-47f8-9e86-8b27fa3be83a tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:02.555350 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b86bbba-86ff-47f8-9e86-8b27fa3be83a tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:02.556317 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b86bbba-86ff-47f8-9e86-8b27fa3be83a tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:02.556770 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b86bbba-86ff-47f8-9e86-8b27fa3be83a tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:02.563960 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.network.neutron [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] validate_networks() for [('16892394-e408-48ab-985b-412d1c45e5c5', None, None, None, None, None)] {{(pid=124815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:38:02.769608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7b86bbba-86ff-47f8-9e86-8b27fa3be83a tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:02.777431 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7b86bbba-86ff-47f8-9e86-8b27fa3be83a tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1676 microversion: 2.1 time: 0.235119 Jun 30 16:38:02.787505 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 287/577] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:02 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1676 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:02.946524 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c15ed0b5-0d2e-4d5a-99d8-58a8b05a6330 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:02.947142 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c15ed0b5-0d2e-4d5a-99d8-58a8b05a6330 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:02.953859 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c15ed0b5-0d2e-4d5a-99d8-58a8b05a6330 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:02.954303 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c15ed0b5-0d2e-4d5a-99d8-58a8b05a6330 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:02.955077 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c15ed0b5-0d2e-4d5a-99d8-58a8b05a6330 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:02.955537 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c15ed0b5-0d2e-4d5a-99d8-58a8b05a6330 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:03.070177 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Flavor limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:38:03.070613 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Image limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:38:03.071085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Flavor pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:38:03.071550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Image pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:38:03.071966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:38:03.082593 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:03.083054 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:03.083908 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:03.084547 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:03.102131 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:38:03.106537 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for user 0a26028451b345968fe86774f44736dd and project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:38:03.115576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:03.117841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c15ed0b5-0d2e-4d5a-99d8-58a8b05a6330 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:03.119583 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Going to run 1 instances... {{(pid=124815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:38:03.121936 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:38:03.126387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c15ed0b5-0d2e-4d5a-99d8-58a8b05a6330 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1319 microversion: 2.1 time: 0.184579 Jun 30 16:38:03.126965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 288/578] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:02 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:38:03.268818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d9b40be7-9e7b-4806-9196-48bcfc2af225 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.830782 Jun 30 16:38:03.269389 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 291/579] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:38:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 16:38:03.279834 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-cae9c14d-03ff-4f8e-b00a-a2e862794b86 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:03.280462 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-cae9c14d-03ff-4f8e-b00a-a2e862794b86 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:03.334165 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-cae9c14d-03ff-4f8e-b00a-a2e862794b86 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:03.341213 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-cae9c14d-03ff-4f8e-b00a-a2e862794b86 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1242 microversion: 2.1 time: 0.065628 Jun 30 16:38:03.342030 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 289/580] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:03 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:03.559942 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-947fcb38-b01b-475d-be0e-af3c50cd8d29 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:03.561468 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-947fcb38-b01b-475d-be0e-af3c50cd8d29 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:03.568778 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-947fcb38-b01b-475d-be0e-af3c50cd8d29 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:03.569204 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-947fcb38-b01b-475d-be0e-af3c50cd8d29 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:03.569996 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-947fcb38-b01b-475d-be0e-af3c50cd8d29 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:03.570446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-947fcb38-b01b-475d-be0e-af3c50cd8d29 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:03.711190 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-947fcb38-b01b-475d-be0e-af3c50cd8d29 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:03.713414 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=100 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:03.720586 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-947fcb38-b01b-475d-be0e-af3c50cd8d29 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.165490 Jun 30 16:38:03.721171 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 292/581] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:03 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:03.798120 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2cca50fd-c535-4ee0-82cc-79e8b167fdf0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:03.798942 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2cca50fd-c535-4ee0-82cc-79e8b167fdf0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:03.808403 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2cca50fd-c535-4ee0-82cc-79e8b167fdf0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:03.808844 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2cca50fd-c535-4ee0-82cc-79e8b167fdf0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:03.809756 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2cca50fd-c535-4ee0-82cc-79e8b167fdf0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:03.815730 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2cca50fd-c535-4ee0-82cc-79e8b167fdf0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:03.951968 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2cca50fd-c535-4ee0-82cc-79e8b167fdf0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:03.959611 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2cca50fd-c535-4ee0-82cc-79e8b167fdf0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1676 microversion: 2.1 time: 0.166810 Jun 30 16:38:03.960251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 290/582] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:03 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1676 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:04.144651 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-780c6bd5-e74a-4f38-97fe-ec115a6760a0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:04.145270 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-780c6bd5-e74a-4f38-97fe-ec115a6760a0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:04.152349 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-780c6bd5-e74a-4f38-97fe-ec115a6760a0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:04.152798 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-780c6bd5-e74a-4f38-97fe-ec115a6760a0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:04.153575 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-780c6bd5-e74a-4f38-97fe-ec115a6760a0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:04.154572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-780c6bd5-e74a-4f38-97fe-ec115a6760a0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:04.293008 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-780c6bd5-e74a-4f38-97fe-ec115a6760a0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:04.302984 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-780c6bd5-e74a-4f38-97fe-ec115a6760a0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1319 microversion: 2.1 time: 0.162611 Jun 30 16:38:04.303761 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 293/583] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:04 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:04.358796 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-eb31ac62-2f58-4035-a40a-ebab840c4fac tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:04.359418 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-eb31ac62-2f58-4035-a40a-ebab840c4fac tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:04.366400 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eb31ac62-2f58-4035-a40a-ebab840c4fac tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:04.366857 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eb31ac62-2f58-4035-a40a-ebab840c4fac tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:04.367857 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eb31ac62-2f58-4035-a40a-ebab840c4fac tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:04.368312 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eb31ac62-2f58-4035-a40a-ebab840c4fac tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:04.407088 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-0042520e-f016-46c6-a5e0-8cab5fe69ebb req-abb746ed-0897-49ba-8624-f3d2485e2a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b", "name": "network-vif-plugged", "status": "completed", "tag": "a8b6c930-9dd0-4e31-b6d2-939648afc8ba"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:04.422099 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-0042520e-f016-46c6-a5e0-8cab5fe69ebb req-abb746ed-0897-49ba-8624-f3d2485e2a0a service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:04.422686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-0042520e-f016-46c6-a5e0-8cab5fe69ebb req-abb746ed-0897-49ba-8624-f3d2485e2a0a service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:04.436771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-0042520e-f016-46c6-a5e0-8cab5fe69ebb req-abb746ed-0897-49ba-8624-f3d2485e2a0a service nova] Creating event network-vif-plugged:a8b6c930-9dd0-4e31-b6d2-939648afc8ba for instance 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b on hv-cinder-83602 Jun 30 16:38:04.440281 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-eb31ac62-2f58-4035-a40a-ebab840c4fac tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:04.445906 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-0042520e-f016-46c6-a5e0-8cab5fe69ebb req-abb746ed-0897-49ba-8624-f3d2485e2a0a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043480 Jun 30 16:38:04.447027 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 294/584] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:38:04.448861 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-eb31ac62-2f58-4035-a40a-ebab840c4fac tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1246 microversion: 2.1 time: 0.094349 Jun 30 16:38:04.453364 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 291/585] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:04 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:04.739606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ee6728d0-0ea7-46f8-aac7-26307f96203b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:04.740312 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ee6728d0-0ea7-46f8-aac7-26307f96203b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:04.747350 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ee6728d0-0ea7-46f8-aac7-26307f96203b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:04.747906 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ee6728d0-0ea7-46f8-aac7-26307f96203b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:04.748797 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ee6728d0-0ea7-46f8-aac7-26307f96203b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:04.749245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ee6728d0-0ea7-46f8-aac7-26307f96203b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:04.917747 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ee6728d0-0ea7-46f8-aac7-26307f96203b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:04.926563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ee6728d0-0ea7-46f8-aac7-26307f96203b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.191873 Jun 30 16:38:04.927360 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 295/586] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:04 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:04.977516 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0958d657-9ed4-4509-80e7-b69c1d6a7567 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:04.978274 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0958d657-9ed4-4509-80e7-b69c1d6a7567 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:04.985790 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0958d657-9ed4-4509-80e7-b69c1d6a7567 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:04.986307 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0958d657-9ed4-4509-80e7-b69c1d6a7567 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:04.987192 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0958d657-9ed4-4509-80e7-b69c1d6a7567 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:04.987629 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0958d657-9ed4-4509-80e7-b69c1d6a7567 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:05.128300 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0958d657-9ed4-4509-80e7-b69c1d6a7567 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:05.136343 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0958d657-9ed4-4509-80e7-b69c1d6a7567 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1676 microversion: 2.1 time: 0.162662 Jun 30 16:38:05.136929 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 292/587] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:04 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:05.321399 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-82d83ddd-8bfe-406c-a419-21c4ef856f6c tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:05.322017 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-82d83ddd-8bfe-406c-a419-21c4ef856f6c tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:05.328483 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-82d83ddd-8bfe-406c-a419-21c4ef856f6c tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:05.331105 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-82d83ddd-8bfe-406c-a419-21c4ef856f6c tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:05.331105 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-82d83ddd-8bfe-406c-a419-21c4ef856f6c tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:05.331105 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-82d83ddd-8bfe-406c-a419-21c4ef856f6c tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:05.467235 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-792ada43-1e31-4b70-befa-b43cef85fe16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:05.467927 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-792ada43-1e31-4b70-befa-b43cef85fe16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:05.470121 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-82d83ddd-8bfe-406c-a419-21c4ef856f6c tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:05.478092 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-82d83ddd-8bfe-406c-a419-21c4ef856f6c tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1319 microversion: 2.1 time: 0.160450 Jun 30 16:38:05.478309 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-792ada43-1e31-4b70-befa-b43cef85fe16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:05.478540 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-792ada43-1e31-4b70-befa-b43cef85fe16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:05.478975 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 296/588] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:05 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:05.481382 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-792ada43-1e31-4b70-befa-b43cef85fe16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:05.481822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-792ada43-1e31-4b70-befa-b43cef85fe16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:05.550191 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-792ada43-1e31-4b70-befa-b43cef85fe16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:05.559142 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-792ada43-1e31-4b70-befa-b43cef85fe16 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1294 microversion: 2.1 time: 0.096610 Jun 30 16:38:05.559846 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 293/589] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:05 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1294 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:38:05.944644 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-36536dc2-201a-47e8-95c0-b78582b3933c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:05.945350 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-36536dc2-201a-47e8-95c0-b78582b3933c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:05.953957 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-36536dc2-201a-47e8-95c0-b78582b3933c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:05.954591 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-36536dc2-201a-47e8-95c0-b78582b3933c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:05.955396 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-36536dc2-201a-47e8-95c0-b78582b3933c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:05.955808 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-36536dc2-201a-47e8-95c0-b78582b3933c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:06.110202 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1142577069", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1686313724", "security_groups": [{"name": "tempest-secgroup-smoke-1280353264"}], "block_device_mapping_v2": [{"uuid": "551e139d-64ea-4eb2-831e-5f335698de98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "65fa0cba-7cff-4856-97c9-e4f078bde7b0"}]}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:06.383639 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.network.neutron [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] validate_networks() for [('65fa0cba-7cff-4856-97c9-e4f078bde7b0', None, None, None, None, None)] {{(pid=124814) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:38:06.434424 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-36536dc2-201a-47e8-95c0-b78582b3933c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:06.443981 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-36536dc2-201a-47e8-95c0-b78582b3933c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.502966 Jun 30 16:38:06.444567 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 297/590] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:05 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:06.449116 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a01e915f-7d9e-46c4-a40e-0bc3688c3ff8 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:06.449713 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a01e915f-7d9e-46c4-a40e-0bc3688c3ff8 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:06.458311 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a01e915f-7d9e-46c4-a40e-0bc3688c3ff8 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:06.458763 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a01e915f-7d9e-46c4-a40e-0bc3688c3ff8 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:06.459577 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a01e915f-7d9e-46c4-a40e-0bc3688c3ff8 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:06.460023 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a01e915f-7d9e-46c4-a40e-0bc3688c3ff8 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:06.760759 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a01e915f-7d9e-46c4-a40e-0bc3688c3ff8 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:06.772299 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a01e915f-7d9e-46c4-a40e-0bc3688c3ff8 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1653 microversion: 2.1 time: 0.326642 Jun 30 16:38:06.773214 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 298/591] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:06 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1653 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:06.779050 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6d7fb803-9ef2-4485-a7ea-c7d12e12cd53 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:06.780543 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6d7fb803-9ef2-4485-a7ea-c7d12e12cd53 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:06.789265 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d7fb803-9ef2-4485-a7ea-c7d12e12cd53 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:06.789713 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d7fb803-9ef2-4485-a7ea-c7d12e12cd53 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:06.790495 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d7fb803-9ef2-4485-a7ea-c7d12e12cd53 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:06.790927 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d7fb803-9ef2-4485-a7ea-c7d12e12cd53 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:07.146497 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6d7fb803-9ef2-4485-a7ea-c7d12e12cd53 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:07.154000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6d7fb803-9ef2-4485-a7ea-c7d12e12cd53 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1509 microversion: 2.1 time: 0.379694 Jun 30 16:38:07.155527 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 299/592] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:06 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1509 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:07.159925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a0b63cba-3bef-42ae-9f7a-f629eb65fc47 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:07.160539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a0b63cba-3bef-42ae-9f7a-f629eb65fc47 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:07.166875 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a0b63cba-3bef-42ae-9f7a-f629eb65fc47 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:07.167570 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a0b63cba-3bef-42ae-9f7a-f629eb65fc47 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:07.168355 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a0b63cba-3bef-42ae-9f7a-f629eb65fc47 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:07.168802 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a0b63cba-3bef-42ae-9f7a-f629eb65fc47 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:07.187909 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Flavor limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:38:07.195292 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Image limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:38:07.195292 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Flavor pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:38:07.195292 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Image pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:38:07.195292 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:38:07.198898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:07.199354 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:07.200202 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:07.200646 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:07.219970 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Getting quotas for project 99847b649bfd4ca6a33cb2ea97ad0469. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:38:07.227083 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Getting quotas for user bb8a8a4e8b634322a92992379c98b721 and project 99847b649bfd4ca6a33cb2ea97ad0469. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:38:07.247026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a0b63cba-3bef-42ae-9f7a-f629eb65fc47 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:07.249227 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a0b63cba-3bef-42ae-9f7a-f629eb65fc47 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1300 microversion: 2.1 time: 0.092624 Jun 30 16:38:07.250137 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 300/593] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:07 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1300 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:07.255691 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-99de985d-fa5d-4cda-8931-0c3208fb5a5b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:07.261976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-99de985d-fa5d-4cda-8931-0c3208fb5a5b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:07.262426 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-99de985d-fa5d-4cda-8931-0c3208fb5a5b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:07.289001 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-99de985d-fa5d-4cda-8931-0c3208fb5a5b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Going to try to start instance {{(pid=124815) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 30 16:38:07.304872 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Going to run 1 instances... {{(pid=124814) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:38:07.306508 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='551e139d-64ea-4eb2-831e-5f335698de98',volume_size=None,volume_type=None)] {{(pid=124814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:38:07.491638 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-99de985d-fa5d-4cda-8931-0c3208fb5a5b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "POST /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/action" status: 202 len: 0 microversion: 2.1 time: 0.239309 Jun 30 16:38:07.492314 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 301/594] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 30 16:38:07 2022] POST /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:38:07.498100 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-5ac4ab76-3cf7-4574-8069-78473013301d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37572dd2-3afe-47a3-8f80-6bc140120ab1", "device": "/dev/sdb"}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:07.499344 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-5ac4ab76-3cf7-4574-8069-78473013301d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:07.507969 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5ac4ab76-3cf7-4574-8069-78473013301d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:07.508472 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5ac4ab76-3cf7-4574-8069-78473013301d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:07.509193 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5ac4ab76-3cf7-4574-8069-78473013301d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:07.509633 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5ac4ab76-3cf7-4574-8069-78473013301d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:07.800539 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0226e756-729d-47ef-8421-4dc30b65dce3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.694701 Jun 30 16:38:07.801628 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 294/595] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:38:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 16:38:07.807658 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-37731b76-f967-4eca-9630-842c5104aafc tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:07.808523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-37731b76-f967-4eca-9630-842c5104aafc tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:07.811180 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:07.820586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-37731b76-f967-4eca-9630-842c5104aafc tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:07.824237 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-37731b76-f967-4eca-9630-842c5104aafc tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:07.824237 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-37731b76-f967-4eca-9630-842c5104aafc tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:07.824237 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-37731b76-f967-4eca-9630-842c5104aafc tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:08.077425 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-37731b76-f967-4eca-9630-842c5104aafc tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:08.085692 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-37731b76-f967-4eca-9630-842c5104aafc tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.282511 Jun 30 16:38:08.086524 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 295/596] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:07 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:08.092923 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f9ca27ef-93ef-4698-8033-2779819ec1b1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:08.093738 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f9ca27ef-93ef-4698-8033-2779819ec1b1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:08.102328 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f9ca27ef-93ef-4698-8033-2779819ec1b1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:08.102328 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f9ca27ef-93ef-4698-8033-2779819ec1b1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:08.104424 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f9ca27ef-93ef-4698-8033-2779819ec1b1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:08.104424 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f9ca27ef-93ef-4698-8033-2779819ec1b1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:08.380597 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f9ca27ef-93ef-4698-8033-2779819ec1b1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:08.388322 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f9ca27ef-93ef-4698-8033-2779819ec1b1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1662 microversion: 2.1 time: 0.300507 Jun 30 16:38:08.388926 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 296/597] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:08 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1662 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:08.393796 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-15df8609-0563-4cda-899a-2eaebd8fc3cc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:08.394436 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-15df8609-0563-4cda-899a-2eaebd8fc3cc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:08.458595 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-15df8609-0563-4cda-899a-2eaebd8fc3cc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:08.466582 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-15df8609-0563-4cda-899a-2eaebd8fc3cc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1095 microversion: 2.1 time: 0.076433 Jun 30 16:38:08.468483 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 297/598] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:08 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:08.473500 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5e25b3aa-9614-49fb-9319-52f1bbe369da tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:08.474366 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5e25b3aa-9614-49fb-9319-52f1bbe369da tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:08.480897 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5e25b3aa-9614-49fb-9319-52f1bbe369da tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:08.481125 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5e25b3aa-9614-49fb-9319-52f1bbe369da tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:08.482024 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5e25b3aa-9614-49fb-9319-52f1bbe369da tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:08.483151 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5e25b3aa-9614-49fb-9319-52f1bbe369da tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:08.509726 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-5ac4ab76-3cf7-4574-8069-78473013301d tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "POST /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.015589 Jun 30 16:38:08.510835 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 302/599] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 30 16:38:07 2022] POST /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b/os-volume_attachments => generated 194 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:38:08.658573 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5e25b3aa-9614-49fb-9319-52f1bbe369da tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:08.665979 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5e25b3aa-9614-49fb-9319-52f1bbe369da tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1368 microversion: 2.1 time: 0.196320 Jun 30 16:38:08.666541 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 298/600] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:08 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:09.055632 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-e837017d-a561-422c-91f4-b2aee429d74b req-92289998-a9d9-4931-876c-f299f10b5046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eddee8f-330d-43f7-8877-50a589622e55", "tag": "11b309b0-51ca-464b-a5e0-614725a89fdb"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:09.065185 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-e837017d-a561-422c-91f4-b2aee429d74b req-92289998-a9d9-4931-876c-f299f10b5046 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:09.065770 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-e837017d-a561-422c-91f4-b2aee429d74b req-92289998-a9d9-4931-876c-f299f10b5046 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:09.078276 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-e837017d-a561-422c-91f4-b2aee429d74b req-92289998-a9d9-4931-876c-f299f10b5046 service nova] Creating event network-changed:11b309b0-51ca-464b-a5e0-614725a89fdb for instance 4eddee8f-330d-43f7-8877-50a589622e55 on hv-cinder-83602 Jun 30 16:38:09.083352 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-e837017d-a561-422c-91f4-b2aee429d74b req-92289998-a9d9-4931-876c-f299f10b5046 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033666 Jun 30 16:38:09.084208 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 303/601] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:38:09.102847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c7413209-227b-44b9-9911-dbc896ac75b3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:09.103519 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c7413209-227b-44b9-9911-dbc896ac75b3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:09.111426 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c7413209-227b-44b9-9911-dbc896ac75b3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:09.111930 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c7413209-227b-44b9-9911-dbc896ac75b3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:09.112702 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c7413209-227b-44b9-9911-dbc896ac75b3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:09.113143 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c7413209-227b-44b9-9911-dbc896ac75b3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:09.254984 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c7413209-227b-44b9-9911-dbc896ac75b3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:09.257294 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=100 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:09.265290 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c7413209-227b-44b9-9911-dbc896ac75b3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.166204 Jun 30 16:38:09.266021 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 299/602] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:09 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:09.407738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a60776e8-1d1d-41df-8fcc-06df68bcee84 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:09.408434 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a60776e8-1d1d-41df-8fcc-06df68bcee84 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:09.415065 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a60776e8-1d1d-41df-8fcc-06df68bcee84 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:09.415563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a60776e8-1d1d-41df-8fcc-06df68bcee84 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:09.416339 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a60776e8-1d1d-41df-8fcc-06df68bcee84 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:09.416769 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a60776e8-1d1d-41df-8fcc-06df68bcee84 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:09.485318 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9afa9d16-4904-40b9-944c-d39bd1908f3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:09.485913 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9afa9d16-4904-40b9-944c-d39bd1908f3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:09.492109 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9afa9d16-4904-40b9-944c-d39bd1908f3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:09.492559 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9afa9d16-4904-40b9-944c-d39bd1908f3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:09.493326 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9afa9d16-4904-40b9-944c-d39bd1908f3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:09.493759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9afa9d16-4904-40b9-944c-d39bd1908f3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:09.587148 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9afa9d16-4904-40b9-944c-d39bd1908f3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:09.597292 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9afa9d16-4904-40b9-944c-d39bd1908f3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1145 microversion: 2.1 time: 0.116717 Jun 30 16:38:09.600108 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 300/603] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:09 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1145 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:38:09.615771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a60776e8-1d1d-41df-8fcc-06df68bcee84 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:09.627658 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a60776e8-1d1d-41df-8fcc-06df68bcee84 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1662 microversion: 2.1 time: 0.224968 Jun 30 16:38:09.628680 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 304/604] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:09 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1662 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:09.684005 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4a2cb653-6edf-4be0-8dc8-54c2cd42f4c9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:09.684611 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4a2cb653-6edf-4be0-8dc8-54c2cd42f4c9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:09.691368 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4a2cb653-6edf-4be0-8dc8-54c2cd42f4c9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:09.691864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4a2cb653-6edf-4be0-8dc8-54c2cd42f4c9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:09.692643 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4a2cb653-6edf-4be0-8dc8-54c2cd42f4c9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:09.693177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4a2cb653-6edf-4be0-8dc8-54c2cd42f4c9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:09.973960 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4a2cb653-6edf-4be0-8dc8-54c2cd42f4c9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:09.981523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-4a2cb653-6edf-4be0-8dc8-54c2cd42f4c9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1368 microversion: 2.1 time: 0.301469 Jun 30 16:38:09.982311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 301/605] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:09 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1368 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:38:10.282353 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-39804070-a0d8-42fa-b2e6-3f04629b55fe tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:10.282880 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-39804070-a0d8-42fa-b2e6-3f04629b55fe tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:10.290939 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-39804070-a0d8-42fa-b2e6-3f04629b55fe tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:10.291640 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-39804070-a0d8-42fa-b2e6-3f04629b55fe tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:10.292646 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-39804070-a0d8-42fa-b2e6-3f04629b55fe tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:10.293380 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-39804070-a0d8-42fa-b2e6-3f04629b55fe tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:10.430684 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-39804070-a0d8-42fa-b2e6-3f04629b55fe tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:10.439371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-39804070-a0d8-42fa-b2e6-3f04629b55fe tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.161079 Jun 30 16:38:10.440298 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 305/606] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:10 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:10.617717 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d413caa5-b628-4234-8e44-be9e1dc5fb77 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:10.618393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d413caa5-b628-4234-8e44-be9e1dc5fb77 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:10.625517 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d413caa5-b628-4234-8e44-be9e1dc5fb77 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:10.625967 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d413caa5-b628-4234-8e44-be9e1dc5fb77 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:10.626740 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d413caa5-b628-4234-8e44-be9e1dc5fb77 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:10.627236 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d413caa5-b628-4234-8e44-be9e1dc5fb77 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:10.649033 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-461c2b8f-ca47-4387-81bd-3c89b11137e0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:10.650409 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-461c2b8f-ca47-4387-81bd-3c89b11137e0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:10.658211 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-461c2b8f-ca47-4387-81bd-3c89b11137e0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:10.658668 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-461c2b8f-ca47-4387-81bd-3c89b11137e0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:10.659494 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-461c2b8f-ca47-4387-81bd-3c89b11137e0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:10.659970 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-461c2b8f-ca47-4387-81bd-3c89b11137e0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:10.702874 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d413caa5-b628-4234-8e44-be9e1dc5fb77 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:10.710557 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d413caa5-b628-4234-8e44-be9e1dc5fb77 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1193 microversion: 2.1 time: 0.098824 Jun 30 16:38:10.711147 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 302/607] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:10 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1193 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:10.805727 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-461c2b8f-ca47-4387-81bd-3c89b11137e0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:10.813396 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-461c2b8f-ca47-4387-81bd-3c89b11137e0 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1666 microversion: 2.1 time: 0.168840 Jun 30 16:38:10.813966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 306/608] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:10 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1666 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:10.998888 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-96b42902-ef64-4406-83d0-e97a59eaf037 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:10.999526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-96b42902-ef64-4406-83d0-e97a59eaf037 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:11.006954 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-96b42902-ef64-4406-83d0-e97a59eaf037 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:11.007412 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-96b42902-ef64-4406-83d0-e97a59eaf037 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:11.008223 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-96b42902-ef64-4406-83d0-e97a59eaf037 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:11.008663 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-96b42902-ef64-4406-83d0-e97a59eaf037 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:11.139501 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-96b42902-ef64-4406-83d0-e97a59eaf037 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:11.147061 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-96b42902-ef64-4406-83d0-e97a59eaf037 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1368 microversion: 2.1 time: 0.152704 Jun 30 16:38:11.147636 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 303/609] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:10 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:11.457274 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-87c93838-c4da-4a01-ae77-486939519628 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:11.457806 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-87c93838-c4da-4a01-ae77-486939519628 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:11.464408 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-87c93838-c4da-4a01-ae77-486939519628 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:11.464863 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-87c93838-c4da-4a01-ae77-486939519628 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:11.465671 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-87c93838-c4da-4a01-ae77-486939519628 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:11.466112 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-87c93838-c4da-4a01-ae77-486939519628 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:11.594951 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-87c93838-c4da-4a01-ae77-486939519628 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:11.603133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-87c93838-c4da-4a01-ae77-486939519628 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1735 microversion: 2.1 time: 0.149854 Jun 30 16:38:11.603727 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 307/610] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:11 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:11.728152 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d433ba9e-7e24-4ea2-b154-6bda74c26d5e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:11.730725 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d433ba9e-7e24-4ea2-b154-6bda74c26d5e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:11.739633 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d433ba9e-7e24-4ea2-b154-6bda74c26d5e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:11.740097 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d433ba9e-7e24-4ea2-b154-6bda74c26d5e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:11.741044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d433ba9e-7e24-4ea2-b154-6bda74c26d5e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:11.741501 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d433ba9e-7e24-4ea2-b154-6bda74c26d5e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:11.809622 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d433ba9e-7e24-4ea2-b154-6bda74c26d5e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:11.818418 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d433ba9e-7e24-4ea2-b154-6bda74c26d5e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1193 microversion: 2.1 time: 0.094480 Jun 30 16:38:11.819005 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 304/611] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:11 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:12.164222 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8a24db1d-328f-453a-9606-290bf63ee55a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:12.164849 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8a24db1d-328f-453a-9606-290bf63ee55a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:12.171940 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8a24db1d-328f-453a-9606-290bf63ee55a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:12.172384 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8a24db1d-328f-453a-9606-290bf63ee55a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:12.173141 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8a24db1d-328f-453a-9606-290bf63ee55a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:12.173601 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8a24db1d-328f-453a-9606-290bf63ee55a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:12.188471 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:12.320235 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8a24db1d-328f-453a-9606-290bf63ee55a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:12.330251 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8a24db1d-328f-453a-9606-290bf63ee55a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1368 microversion: 2.1 time: 0.169766 Jun 30 16:38:12.331047 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 308/612] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:12 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:12.623623 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-bea426b6-adc3-4470-bdbc-999f938cf627 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:12.624731 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-bea426b6-adc3-4470-bdbc-999f938cf627 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:12.634416 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bea426b6-adc3-4470-bdbc-999f938cf627 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:12.635170 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bea426b6-adc3-4470-bdbc-999f938cf627 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:12.637983 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bea426b6-adc3-4470-bdbc-999f938cf627 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:12.637983 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bea426b6-adc3-4470-bdbc-999f938cf627 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:12.785069 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-bea426b6-adc3-4470-bdbc-999f938cf627 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:12.793823 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-bea426b6-adc3-4470-bdbc-999f938cf627 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1715 microversion: 2.1 time: 0.177496 Jun 30 16:38:12.798511 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 305/613] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:12 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1715 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:12.839464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-93120f88-79ba-4e2d-9ba0-5f6a3b41a332 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:12.840157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-93120f88-79ba-4e2d-9ba0-5f6a3b41a332 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:12.848384 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-93120f88-79ba-4e2d-9ba0-5f6a3b41a332 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:12.850205 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-93120f88-79ba-4e2d-9ba0-5f6a3b41a332 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:12.850205 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-93120f88-79ba-4e2d-9ba0-5f6a3b41a332 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:12.850205 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-93120f88-79ba-4e2d-9ba0-5f6a3b41a332 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:12.925095 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-93120f88-79ba-4e2d-9ba0-5f6a3b41a332 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:12.937835 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8e73da6c-3f36-45ac-b9e4-c4766a3c27b9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:12.937835 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8e73da6c-3f36-45ac-b9e4-c4766a3c27b9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:12.948294 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-93120f88-79ba-4e2d-9ba0-5f6a3b41a332 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1211 microversion: 2.1 time: 0.114900 Jun 30 16:38:12.949167 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 309/614] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:12 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1211 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:12.960768 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8e73da6c-3f36-45ac-b9e4-c4766a3c27b9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:12.961360 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8e73da6c-3f36-45ac-b9e4-c4766a3c27b9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:12.962161 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8e73da6c-3f36-45ac-b9e4-c4766a3c27b9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:12.962662 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8e73da6c-3f36-45ac-b9e4-c4766a3c27b9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:13.049049 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-8e73da6c-3f36-45ac-b9e4-c4766a3c27b9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] HTTP exception thrown: Cannot 'detach_volume' instance d786bea4-1a92-4eaf-8450-f69f05986687 while it is in vm_state rescued Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8e73da6c-3f36-45ac-b9e4-c4766a3c27b9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Request method failure captured: Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: DELETE /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments/37abf47d-f6e3-4ce8-a076-c00dacefb402 HTTP/1.1 Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdBwM9qvHtOnFqUQDtbBU25dM8LsDJJTw1pxd--fjd3blMXEcKPhQWZ-a27FdgjxBMK6dTUcUQH6ay8X0VGGzhyFlL71iFHTgsLgL0YYMg5CBUCtAhR-PSa6BNDD22qbdj4XsHc-GH7-1ZaAlg1BvKwRS17UakMMM4b-BX-kEr6NtA0 Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 839a189179c543c6a704a968170ec022 Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:38:13.050714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:38:13.052277 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/839a189179c543c6a704a968170ec022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/839a189179c543c6a704a968170ec022"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_839a189179c543c6a704a968170ec022"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/839a189179c543c6a704a968170ec022"}]}] Jun 30 16:38:13.052277 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:38:13.052277 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 839a189179c543c6a704a968170ec022 Jun 30 16:38:13.052277 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:38:13.052277 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-ServerRescueNegativeTestJSON-1419143453-project Jun 30 16:38:13.052277 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:38:13.052277 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:38:13.052277 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 2de23770f4374decb95ff94f3e7f793b Jun 30 16:38:13.052277 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1419143453-project Jun 30 16:38:13.052277 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:38:13.052277 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Cannot 'detach_volume' instance d786bea4-1a92-4eaf-8450-f69f05986687 while it is in vm_state rescued Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'server_id': 'd786bea4-1a92-4eaf-8450-f69f05986687', 'id': '37abf47d-f6e3-4ce8-a076-c00dacefb402'} Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d786bea4-1a92-4eaf-8450-f69f05986687 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:38:13.053440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d786bea4-1a92-4eaf-8450-f69f05986687 while it is in vm_state rescued Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d786bea4-1a92-4eaf-8450-f69f05986687 while it is in vm_state rescued Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:38:13.054848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8e73da6c-3f36-45ac-b9e4-c4766a3c27b9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Returning 409 to user: Cannot 'detach_volume' instance d786bea4-1a92-4eaf-8450-f69f05986687 while it is in vm_state rescued {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:38:13.058347 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8e73da6c-3f36-45ac-b9e4-c4766a3c27b9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments/37abf47d-f6e3-4ce8-a076-c00dacefb402" status: 409 len: 152 microversion: 2.1 time: 0.125602 Jun 30 16:38:13.058347 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 306/615] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 30 16:38:12 2022] DELETE /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments/37abf47d-f6e3-4ce8-a076-c00dacefb402 => generated 152 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 30 16:38:13.062167 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1130e8f5-881a-4167-aece-7ad6ebbda23d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:13.062704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1130e8f5-881a-4167-aece-7ad6ebbda23d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:13.068888 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1130e8f5-881a-4167-aece-7ad6ebbda23d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:13.069340 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1130e8f5-881a-4167-aece-7ad6ebbda23d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:13.070140 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1130e8f5-881a-4167-aece-7ad6ebbda23d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:13.070571 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1130e8f5-881a-4167-aece-7ad6ebbda23d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:13.092616 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:13.117568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=10 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:13.299523 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1130e8f5-881a-4167-aece-7ad6ebbda23d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "POST /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/action" status: 202 len: 0 microversion: 2.1 time: 0.241711 Jun 30 16:38:13.300460 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 310/616] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 30 16:38:13 2022] POST /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:38:13.316136 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9beb11cd-7dbf-40ad-b2a2-6b35155845d7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:13.317014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9beb11cd-7dbf-40ad-b2a2-6b35155845d7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:13.323168 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9beb11cd-7dbf-40ad-b2a2-6b35155845d7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:13.323653 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9beb11cd-7dbf-40ad-b2a2-6b35155845d7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:13.324431 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9beb11cd-7dbf-40ad-b2a2-6b35155845d7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:13.324862 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9beb11cd-7dbf-40ad-b2a2-6b35155845d7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:13.347695 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0690993d-85fe-4c75-ae22-769ec13a5425 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:13.348401 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-0690993d-85fe-4c75-ae22-769ec13a5425 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:13.354756 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0690993d-85fe-4c75-ae22-769ec13a5425 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:13.355460 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0690993d-85fe-4c75-ae22-769ec13a5425 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:13.356386 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0690993d-85fe-4c75-ae22-769ec13a5425 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:13.356836 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0690993d-85fe-4c75-ae22-769ec13a5425 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:13.530898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9beb11cd-7dbf-40ad-b2a2-6b35155845d7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:13.534734 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-0690993d-85fe-4c75-ae22-769ec13a5425 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:13.539117 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9beb11cd-7dbf-40ad-b2a2-6b35155845d7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1723 microversion: 2.1 time: 0.228422 Jun 30 16:38:13.539718 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 307/617] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:13 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:13.542297 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-0690993d-85fe-4c75-ae22-769ec13a5425 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1368 microversion: 2.1 time: 0.199622 Jun 30 16:38:13.542855 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 311/618] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:13 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:13.973298 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f1b52067-b5b8-4b01-88ef-0cc9b743e21c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:13.973922 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f1b52067-b5b8-4b01-88ef-0cc9b743e21c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:13.981000 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f1b52067-b5b8-4b01-88ef-0cc9b743e21c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:13.981820 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f1b52067-b5b8-4b01-88ef-0cc9b743e21c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:13.983113 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f1b52067-b5b8-4b01-88ef-0cc9b743e21c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:13.983856 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f1b52067-b5b8-4b01-88ef-0cc9b743e21c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:14.451162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f1b52067-b5b8-4b01-88ef-0cc9b743e21c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:14.459705 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f1b52067-b5b8-4b01-88ef-0cc9b743e21c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1279 microversion: 2.1 time: 0.490340 Jun 30 16:38:14.460366 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 308/619] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:13 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1279 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:14.558138 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-5a2d86ad-1d1b-4189-8cb8-bff7f8dab832 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:14.559418 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-5a2d86ad-1d1b-4189-8cb8-bff7f8dab832 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:14.560020 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c93e19f5-f024-48c0-92cb-50f62fa75c80 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:14.561506 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c93e19f5-f024-48c0-92cb-50f62fa75c80 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:14.572232 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c93e19f5-f024-48c0-92cb-50f62fa75c80 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:14.572915 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c93e19f5-f024-48c0-92cb-50f62fa75c80 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:14.573861 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c93e19f5-f024-48c0-92cb-50f62fa75c80 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:14.574447 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c93e19f5-f024-48c0-92cb-50f62fa75c80 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:14.581624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5a2d86ad-1d1b-4189-8cb8-bff7f8dab832 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:14.582458 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5a2d86ad-1d1b-4189-8cb8-bff7f8dab832 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:14.584582 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5a2d86ad-1d1b-4189-8cb8-bff7f8dab832 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:14.585268 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5a2d86ad-1d1b-4189-8cb8-bff7f8dab832 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:14.898177 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5a2d86ad-1d1b-4189-8cb8-bff7f8dab832 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:14.916164 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c93e19f5-f024-48c0-92cb-50f62fa75c80 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:14.934398 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-5a2d86ad-1d1b-4189-8cb8-bff7f8dab832 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1723 microversion: 2.1 time: 0.377657 Jun 30 16:38:14.934658 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c93e19f5-f024-48c0-92cb-50f62fa75c80 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1368 microversion: 2.1 time: 0.376009 Jun 30 16:38:14.938873 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 312/620] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:14 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1723 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:14.940478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 309/621] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:14 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1368 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:38:14.952303 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-23f7a0d3-ba17-430b-afff-f439e738e998 req-23910c1b-caa4-4510-a34d-674ec9de954c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cb685e-c960-41dc-89ad-bc5cabc56565", "tag": "2cf2d7d3-c6a6-4edb-8d6d-b8575a6abf8c"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:14.962330 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-23f7a0d3-ba17-430b-afff-f439e738e998 req-23910c1b-caa4-4510-a34d-674ec9de954c service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:14.962787 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-23f7a0d3-ba17-430b-afff-f439e738e998 req-23910c1b-caa4-4510-a34d-674ec9de954c service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:14.985972 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-23f7a0d3-ba17-430b-afff-f439e738e998 req-23910c1b-caa4-4510-a34d-674ec9de954c service nova] Creating event network-changed:2cf2d7d3-c6a6-4edb-8d6d-b8575a6abf8c for instance d8cb685e-c960-41dc-89ad-bc5cabc56565 on hv-cinder-83602 Jun 30 16:38:14.998272 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-23f7a0d3-ba17-430b-afff-f439e738e998 req-23910c1b-caa4-4510-a34d-674ec9de954c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046287 Jun 30 16:38:14.998272 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 313/622] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:38:15.476668 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7de685f6-d2e0-46d3-bbf1-389fc83d2fd4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:15.477245 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7de685f6-d2e0-46d3-bbf1-389fc83d2fd4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:15.484042 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7de685f6-d2e0-46d3-bbf1-389fc83d2fd4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:15.484499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7de685f6-d2e0-46d3-bbf1-389fc83d2fd4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:15.485278 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7de685f6-d2e0-46d3-bbf1-389fc83d2fd4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:15.485716 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7de685f6-d2e0-46d3-bbf1-389fc83d2fd4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:15.616306 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7de685f6-d2e0-46d3-bbf1-389fc83d2fd4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:15.623804 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7de685f6-d2e0-46d3-bbf1-389fc83d2fd4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1279 microversion: 2.1 time: 0.151108 Jun 30 16:38:15.624374 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 310/623] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:15 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1279 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:15.950883 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-25bb6cac-6d84-4da2-9b8e-3c927a6c9cad tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:15.952656 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-25bb6cac-6d84-4da2-9b8e-3c927a6c9cad tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:15.957627 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-cf49b631-938b-4cc0-b86b-d39b2f053ed1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:15.958248 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-cf49b631-938b-4cc0-b86b-d39b2f053ed1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:15.959547 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-25bb6cac-6d84-4da2-9b8e-3c927a6c9cad tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:15.960008 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-25bb6cac-6d84-4da2-9b8e-3c927a6c9cad tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:15.960791 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-25bb6cac-6d84-4da2-9b8e-3c927a6c9cad tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:15.961233 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-25bb6cac-6d84-4da2-9b8e-3c927a6c9cad tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:15.964416 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cf49b631-938b-4cc0-b86b-d39b2f053ed1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:15.964871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cf49b631-938b-4cc0-b86b-d39b2f053ed1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:15.965645 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cf49b631-938b-4cc0-b86b-d39b2f053ed1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:15.966152 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cf49b631-938b-4cc0-b86b-d39b2f053ed1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:16.164931 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-25bb6cac-6d84-4da2-9b8e-3c927a6c9cad tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:16.168352 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-cf49b631-938b-4cc0-b86b-d39b2f053ed1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:16.174696 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-25bb6cac-6d84-4da2-9b8e-3c927a6c9cad tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1723 microversion: 2.1 time: 0.227486 Jun 30 16:38:16.174696 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 314/624] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:15 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:16.177351 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-cf49b631-938b-4cc0-b86b-d39b2f053ed1 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1368 microversion: 2.1 time: 0.223843 Jun 30 16:38:16.183874 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 311/625] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:15 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1368 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:16.640655 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ec8ef1e7-a89b-4273-9c6d-ac870f8d4abb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:16.641269 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ec8ef1e7-a89b-4273-9c6d-ac870f8d4abb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:16.647362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ec8ef1e7-a89b-4273-9c6d-ac870f8d4abb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:16.647842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ec8ef1e7-a89b-4273-9c6d-ac870f8d4abb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:16.648639 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ec8ef1e7-a89b-4273-9c6d-ac870f8d4abb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:16.649076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ec8ef1e7-a89b-4273-9c6d-ac870f8d4abb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:16.783155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ec8ef1e7-a89b-4273-9c6d-ac870f8d4abb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:16.790965 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ec8ef1e7-a89b-4273-9c6d-ac870f8d4abb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1279 microversion: 2.1 time: 0.154267 Jun 30 16:38:16.791795 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 315/626] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:16 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1279 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:17.191346 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0c30cff5-43bf-4822-812d-275c7b9b98b2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:17.191985 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0c30cff5-43bf-4822-812d-275c7b9b98b2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:17.195352 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-cf7974a1-cc89-4b9a-9ad6-9df6ce04d93b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:17.196013 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-cf7974a1-cc89-4b9a-9ad6-9df6ce04d93b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:17.198579 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0c30cff5-43bf-4822-812d-275c7b9b98b2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:17.199034 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0c30cff5-43bf-4822-812d-275c7b9b98b2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:17.199841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0c30cff5-43bf-4822-812d-275c7b9b98b2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:17.200286 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0c30cff5-43bf-4822-812d-275c7b9b98b2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:17.203869 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cf7974a1-cc89-4b9a-9ad6-9df6ce04d93b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:17.204322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cf7974a1-cc89-4b9a-9ad6-9df6ce04d93b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:17.205125 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cf7974a1-cc89-4b9a-9ad6-9df6ce04d93b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:17.205565 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cf7974a1-cc89-4b9a-9ad6-9df6ce04d93b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:17.215964 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=2 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:17.400285 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0c30cff5-43bf-4822-812d-275c7b9b98b2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:17.414509 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-cf7974a1-cc89-4b9a-9ad6-9df6ce04d93b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:17.414806 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0c30cff5-43bf-4822-812d-275c7b9b98b2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1723 microversion: 2.1 time: 0.220809 Jun 30 16:38:17.414806 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 312/627] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:17 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:17.414977 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-cf7974a1-cc89-4b9a-9ad6-9df6ce04d93b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1368 microversion: 2.1 time: 0.220329 Jun 30 16:38:17.414977 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 316/628] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:17 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:38:17.808498 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-b4528644-6105-43e9-83f4-f0275ae78c74 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:17.809108 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-b4528644-6105-43e9-83f4-f0275ae78c74 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:17.816077 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b4528644-6105-43e9-83f4-f0275ae78c74 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:17.816529 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b4528644-6105-43e9-83f4-f0275ae78c74 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:17.817323 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b4528644-6105-43e9-83f4-f0275ae78c74 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:17.817773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b4528644-6105-43e9-83f4-f0275ae78c74 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:17.956906 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b4528644-6105-43e9-83f4-f0275ae78c74 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:17.964479 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-b4528644-6105-43e9-83f4-f0275ae78c74 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1279 microversion: 2.1 time: 0.159882 Jun 30 16:38:17.965041 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 313/629] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:17 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:38:18.426377 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-24b3e79f-453d-4919-8800-89ec55bc4a30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:18.427060 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-24b3e79f-453d-4919-8800-89ec55bc4a30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:18.429852 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2ec425a7-4377-434d-bda1-f6d02ba7006f tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:18.430472 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2ec425a7-4377-434d-bda1-f6d02ba7006f tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:18.435029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-24b3e79f-453d-4919-8800-89ec55bc4a30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:18.435654 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-24b3e79f-453d-4919-8800-89ec55bc4a30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:18.436570 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-24b3e79f-453d-4919-8800-89ec55bc4a30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:18.437092 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-24b3e79f-453d-4919-8800-89ec55bc4a30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:18.438078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2ec425a7-4377-434d-bda1-f6d02ba7006f tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:18.438536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2ec425a7-4377-434d-bda1-f6d02ba7006f tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:18.439320 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2ec425a7-4377-434d-bda1-f6d02ba7006f tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:18.439810 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2ec425a7-4377-434d-bda1-f6d02ba7006f tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:18.464077 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=10 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:18.670953 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-24b3e79f-453d-4919-8800-89ec55bc4a30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:18.675948 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2ec425a7-4377-434d-bda1-f6d02ba7006f tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:18.680434 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-24b3e79f-453d-4919-8800-89ec55bc4a30 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1729 microversion: 2.1 time: 0.258193 Jun 30 16:38:18.692243 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 317/630] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:18 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1729 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:18.692527 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2ec425a7-4377-434d-bda1-f6d02ba7006f tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1368 microversion: 2.1 time: 0.259060 Jun 30 16:38:18.692631 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-a6b82e7c-229a-4e76-90d5-a3819143e767 req-5268745d-5e45-42dd-ad73-2ca995a98f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eddee8f-330d-43f7-8877-50a589622e55", "name": "network-vif-plugged", "status": "completed", "tag": "11b309b0-51ca-464b-a5e0-614725a89fdb"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:18.694157 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 314/631] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:18 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1368 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:18.695154 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-a6b82e7c-229a-4e76-90d5-a3819143e767 req-5268745d-5e45-42dd-ad73-2ca995a98f99 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:18.695746 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-a6b82e7c-229a-4e76-90d5-a3819143e767 req-5268745d-5e45-42dd-ad73-2ca995a98f99 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:18.699177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f896cab7-20fa-4957-b6e5-96a68c1b869c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:18.699731 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f896cab7-20fa-4957-b6e5-96a68c1b869c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:18.706738 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f896cab7-20fa-4957-b6e5-96a68c1b869c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:18.707193 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f896cab7-20fa-4957-b6e5-96a68c1b869c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:18.707998 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f896cab7-20fa-4957-b6e5-96a68c1b869c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:18.708440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f896cab7-20fa-4957-b6e5-96a68c1b869c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:18.709984 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-a6b82e7c-229a-4e76-90d5-a3819143e767 req-5268745d-5e45-42dd-ad73-2ca995a98f99 service nova] Creating event network-vif-plugged:11b309b0-51ca-464b-a5e0-614725a89fdb for instance 4eddee8f-330d-43f7-8877-50a589622e55 on hv-cinder-83602 Jun 30 16:38:18.716099 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-a6b82e7c-229a-4e76-90d5-a3819143e767 req-5268745d-5e45-42dd-ad73-2ca995a98f99 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032848 Jun 30 16:38:18.720533 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 318/632] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:38:18.806587 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f896cab7-20fa-4957-b6e5-96a68c1b869c tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108769 Jun 30 16:38:18.806587 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 315/633] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 30 16:38:18 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:38:18.982555 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-31ebcf45-4252-4a5f-86ec-74770313657a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:18.983878 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-31ebcf45-4252-4a5f-86ec-74770313657a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:18.990355 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-31ebcf45-4252-4a5f-86ec-74770313657a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:18.991034 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-31ebcf45-4252-4a5f-86ec-74770313657a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:18.991952 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-31ebcf45-4252-4a5f-86ec-74770313657a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:18.992471 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-31ebcf45-4252-4a5f-86ec-74770313657a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:19.215871 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-31ebcf45-4252-4a5f-86ec-74770313657a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:19.225228 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-31ebcf45-4252-4a5f-86ec-74770313657a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1279 microversion: 2.1 time: 0.247128 Jun 30 16:38:19.231566 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 319/634] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:18 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1279 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:19.703355 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-38589a13-76d5-428e-b70b-3249cf7ea2ee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:19.703355 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-38589a13-76d5-428e-b70b-3249cf7ea2ee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:19.710184 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-38589a13-76d5-428e-b70b-3249cf7ea2ee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:19.710643 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-38589a13-76d5-428e-b70b-3249cf7ea2ee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:19.711426 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-38589a13-76d5-428e-b70b-3249cf7ea2ee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:19.711904 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-38589a13-76d5-428e-b70b-3249cf7ea2ee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:19.859422 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-38589a13-76d5-428e-b70b-3249cf7ea2ee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:19.861863 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=100 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:19.868566 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-38589a13-76d5-428e-b70b-3249cf7ea2ee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1368 microversion: 2.1 time: 0.171446 Jun 30 16:38:19.869279 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 316/635] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:19 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:19.886556 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-7e00f0f3-2f06-4642-9a51-0db822b663a0 req-975887ce-1299-410c-80c3-1328f4f5a0ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d786bea4-1a92-4eaf-8450-f69f05986687", "tag": "237f85c7-d517-4bd7-9b4c-cfb1b755a321"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:19.897015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-7e00f0f3-2f06-4642-9a51-0db822b663a0 req-975887ce-1299-410c-80c3-1328f4f5a0ff service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:19.897015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-7e00f0f3-2f06-4642-9a51-0db822b663a0 req-975887ce-1299-410c-80c3-1328f4f5a0ff service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:19.908355 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-7e00f0f3-2f06-4642-9a51-0db822b663a0 req-975887ce-1299-410c-80c3-1328f4f5a0ff service nova] Creating event network-changed:237f85c7-d517-4bd7-9b4c-cfb1b755a321 for instance d786bea4-1a92-4eaf-8450-f69f05986687 on hv-cinder-83602 Jun 30 16:38:19.913342 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-7e00f0f3-2f06-4642-9a51-0db822b663a0 req-975887ce-1299-410c-80c3-1328f4f5a0ff service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030953 Jun 30 16:38:19.913945 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 320/636] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:38:20.243388 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e0183ce5-a30d-440f-884b-506636bbc6cc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:20.244170 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e0183ce5-a30d-440f-884b-506636bbc6cc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:20.250903 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e0183ce5-a30d-440f-884b-506636bbc6cc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:20.251358 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e0183ce5-a30d-440f-884b-506636bbc6cc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:20.252224 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e0183ce5-a30d-440f-884b-506636bbc6cc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:20.252625 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e0183ce5-a30d-440f-884b-506636bbc6cc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:20.396132 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-e0183ce5-a30d-440f-884b-506636bbc6cc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:20.403657 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e0183ce5-a30d-440f-884b-506636bbc6cc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1279 microversion: 2.1 time: 0.164106 Jun 30 16:38:20.404228 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 317/637] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:20 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1279 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:20.886756 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-5d2cb64b-5824-475d-b5a1-f0c337286053 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:20.887441 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-5d2cb64b-5824-475d-b5a1-f0c337286053 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:20.895156 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5d2cb64b-5824-475d-b5a1-f0c337286053 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:20.895629 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5d2cb64b-5824-475d-b5a1-f0c337286053 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:20.896495 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5d2cb64b-5824-475d-b5a1-f0c337286053 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:20.896927 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5d2cb64b-5824-475d-b5a1-f0c337286053 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:21.033606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5d2cb64b-5824-475d-b5a1-f0c337286053 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:21.040973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-5d2cb64b-5824-475d-b5a1-f0c337286053 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1368 microversion: 2.1 time: 0.158468 Jun 30 16:38:21.041534 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 321/638] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:20 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:21.420696 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4aff8c7c-d75e-4b81-9508-6cb6efec9e4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:21.421879 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4aff8c7c-d75e-4b81-9508-6cb6efec9e4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:21.428912 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4aff8c7c-d75e-4b81-9508-6cb6efec9e4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:21.429371 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4aff8c7c-d75e-4b81-9508-6cb6efec9e4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:21.430121 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4aff8c7c-d75e-4b81-9508-6cb6efec9e4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:21.430556 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4aff8c7c-d75e-4b81-9508-6cb6efec9e4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:21.566539 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4aff8c7c-d75e-4b81-9508-6cb6efec9e4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:21.574163 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-4aff8c7c-d75e-4b81-9508-6cb6efec9e4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1279 microversion: 2.1 time: 0.157384 Jun 30 16:38:21.574731 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 318/639] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:21 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:21.930858 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-529a0613-bc9d-48dc-a277-4567d5340855 req-937f3585-b032-42d7-aa97-c73aafa25090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d786bea4-1a92-4eaf-8450-f69f05986687", "tag": "237f85c7-d517-4bd7-9b4c-cfb1b755a321"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:21.940784 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-529a0613-bc9d-48dc-a277-4567d5340855 req-937f3585-b032-42d7-aa97-c73aafa25090 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:21.941228 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-529a0613-bc9d-48dc-a277-4567d5340855 req-937f3585-b032-42d7-aa97-c73aafa25090 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:21.955271 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-529a0613-bc9d-48dc-a277-4567d5340855 req-937f3585-b032-42d7-aa97-c73aafa25090 service nova] Creating event network-changed:237f85c7-d517-4bd7-9b4c-cfb1b755a321 for instance d786bea4-1a92-4eaf-8450-f69f05986687 on hv-cinder-83602 Jun 30 16:38:21.960958 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-529a0613-bc9d-48dc-a277-4567d5340855 req-937f3585-b032-42d7-aa97-c73aafa25090 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034673 Jun 30 16:38:21.961566 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 322/640] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:38:22.058081 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-14ccbcff-1a1f-4e5d-bc12-dd0a04a5dbbd tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:22.058692 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-14ccbcff-1a1f-4e5d-bc12-dd0a04a5dbbd tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:22.064954 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-14ccbcff-1a1f-4e5d-bc12-dd0a04a5dbbd tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:22.065408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-14ccbcff-1a1f-4e5d-bc12-dd0a04a5dbbd tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:22.066218 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-14ccbcff-1a1f-4e5d-bc12-dd0a04a5dbbd tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:22.066659 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-14ccbcff-1a1f-4e5d-bc12-dd0a04a5dbbd tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:22.197720 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-14ccbcff-1a1f-4e5d-bc12-dd0a04a5dbbd tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:22.205893 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-14ccbcff-1a1f-4e5d-bc12-dd0a04a5dbbd tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1368 microversion: 2.1 time: 0.151675 Jun 30 16:38:22.206488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 319/641] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:22 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:22.592169 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c8df2445-ade2-4489-9384-0c2d3890a4c7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:22.592866 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c8df2445-ade2-4489-9384-0c2d3890a4c7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:22.599661 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c8df2445-ade2-4489-9384-0c2d3890a4c7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:22.600117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c8df2445-ade2-4489-9384-0c2d3890a4c7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:22.600887 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c8df2445-ade2-4489-9384-0c2d3890a4c7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:22.601327 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c8df2445-ade2-4489-9384-0c2d3890a4c7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:22.733518 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c8df2445-ade2-4489-9384-0c2d3890a4c7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:22.741793 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c8df2445-ade2-4489-9384-0c2d3890a4c7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1279 microversion: 2.1 time: 0.154242 Jun 30 16:38:22.742355 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 323/642] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:22 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1279 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:23.223648 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-04f4a7be-2272-4a79-8be4-76724463f830 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:23.224252 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-04f4a7be-2272-4a79-8be4-76724463f830 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:23.230812 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-04f4a7be-2272-4a79-8be4-76724463f830 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:23.231256 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-04f4a7be-2272-4a79-8be4-76724463f830 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:23.232041 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-04f4a7be-2272-4a79-8be4-76724463f830 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:23.232474 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-04f4a7be-2272-4a79-8be4-76724463f830 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:23.372412 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-04f4a7be-2272-4a79-8be4-76724463f830 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:23.380084 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-04f4a7be-2272-4a79-8be4-76724463f830 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1368 microversion: 2.1 time: 0.160442 Jun 30 16:38:23.380661 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 320/643] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:23 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:23.759523 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d3d7d591-f38b-48af-bed7-dc2cfd5bbd92 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:23.760136 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d3d7d591-f38b-48af-bed7-dc2cfd5bbd92 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:23.768192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d3d7d591-f38b-48af-bed7-dc2cfd5bbd92 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:23.769608 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d3d7d591-f38b-48af-bed7-dc2cfd5bbd92 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:23.769608 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d3d7d591-f38b-48af-bed7-dc2cfd5bbd92 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:23.769879 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d3d7d591-f38b-48af-bed7-dc2cfd5bbd92 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:23.913036 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d3d7d591-f38b-48af-bed7-dc2cfd5bbd92 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:23.920557 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d3d7d591-f38b-48af-bed7-dc2cfd5bbd92 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1279 microversion: 2.1 time: 0.164970 Jun 30 16:38:23.921313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 324/644] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:23 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:24.397587 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d9846184-eb83-44af-b1a0-7d67283006ff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:24.398223 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d9846184-eb83-44af-b1a0-7d67283006ff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:24.404918 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d9846184-eb83-44af-b1a0-7d67283006ff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:24.405362 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d9846184-eb83-44af-b1a0-7d67283006ff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:24.406883 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d9846184-eb83-44af-b1a0-7d67283006ff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:24.407317 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d9846184-eb83-44af-b1a0-7d67283006ff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:24.604095 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d9846184-eb83-44af-b1a0-7d67283006ff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:24.612666 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d9846184-eb83-44af-b1a0-7d67283006ff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1368 microversion: 2.1 time: 0.219054 Jun 30 16:38:24.613454 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 321/645] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:24 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:24.939172 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-139ed3f6-cc3d-4649-ac43-3a186c6562b9 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:24.939583 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-139ed3f6-cc3d-4649-ac43-3a186c6562b9 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:24.946335 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-139ed3f6-cc3d-4649-ac43-3a186c6562b9 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:24.949329 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-139ed3f6-cc3d-4649-ac43-3a186c6562b9 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:24.949329 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-139ed3f6-cc3d-4649-ac43-3a186c6562b9 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:24.949329 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-139ed3f6-cc3d-4649-ac43-3a186c6562b9 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:25.087219 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-139ed3f6-cc3d-4649-ac43-3a186c6562b9 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:25.096868 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-139ed3f6-cc3d-4649-ac43-3a186c6562b9 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1267 microversion: 2.1 time: 0.162353 Jun 30 16:38:25.097462 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 325/646] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:24 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:25.630117 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8ea7825c-0a26-402e-a154-61b4a9308d43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:25.630818 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8ea7825c-0a26-402e-a154-61b4a9308d43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:25.637474 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8ea7825c-0a26-402e-a154-61b4a9308d43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:25.637961 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8ea7825c-0a26-402e-a154-61b4a9308d43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:25.638732 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8ea7825c-0a26-402e-a154-61b4a9308d43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:25.639192 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8ea7825c-0a26-402e-a154-61b4a9308d43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:25.773152 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8ea7825c-0a26-402e-a154-61b4a9308d43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:25.781325 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8ea7825c-0a26-402e-a154-61b4a9308d43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1558 microversion: 2.1 time: 0.154519 Jun 30 16:38:25.781993 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 322/647] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:25 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:25.798130 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-fb4248ca-0e63-4c76-9781-05fc5e163050 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:25.799900 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-fb4248ca-0e63-4c76-9781-05fc5e163050 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:25.804882 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fb4248ca-0e63-4c76-9781-05fc5e163050 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:25.805335 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fb4248ca-0e63-4c76-9781-05fc5e163050 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:25.806100 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fb4248ca-0e63-4c76-9781-05fc5e163050 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:25.806541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fb4248ca-0e63-4c76-9781-05fc5e163050 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:25.883718 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-fb4248ca-0e63-4c76-9781-05fc5e163050 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090002 Jun 30 16:38:25.884320 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 326/648] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 30 16:38:25 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:38:26.115829 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-17a0ab15-7d72-4aa4-ad10-66f8f5b440fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:26.116443 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-17a0ab15-7d72-4aa4-ad10-66f8f5b440fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:26.122747 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-17a0ab15-7d72-4aa4-ad10-66f8f5b440fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:26.123206 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-17a0ab15-7d72-4aa4-ad10-66f8f5b440fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:26.124021 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-17a0ab15-7d72-4aa4-ad10-66f8f5b440fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:26.124520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-17a0ab15-7d72-4aa4-ad10-66f8f5b440fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:26.262798 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-17a0ab15-7d72-4aa4-ad10-66f8f5b440fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:26.271590 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-17a0ab15-7d72-4aa4-ad10-66f8f5b440fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1267 microversion: 2.1 time: 0.159669 Jun 30 16:38:26.272613 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 323/649] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:26 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:26.901407 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-429f9957-d203-4261-88fb-576ce09ec4e4 req-4691414e-4e23-4eb0-81a9-8f7c705bc6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eddee8f-330d-43f7-8877-50a589622e55", "tag": "11b309b0-51ca-464b-a5e0-614725a89fdb"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:26.910132 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-429f9957-d203-4261-88fb-576ce09ec4e4 req-4691414e-4e23-4eb0-81a9-8f7c705bc6d3 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:26.913213 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-429f9957-d203-4261-88fb-576ce09ec4e4 req-4691414e-4e23-4eb0-81a9-8f7c705bc6d3 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:26.913416 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:26.924351 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-429f9957-d203-4261-88fb-576ce09ec4e4 req-4691414e-4e23-4eb0-81a9-8f7c705bc6d3 service nova] Creating event network-changed:11b309b0-51ca-464b-a5e0-614725a89fdb for instance 4eddee8f-330d-43f7-8877-50a589622e55 on hv-cinder-83602 Jun 30 16:38:26.929923 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-429f9957-d203-4261-88fb-576ce09ec4e4 req-4691414e-4e23-4eb0-81a9-8f7c705bc6d3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032781 Jun 30 16:38:26.930609 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 327/650] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:38:27.288337 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2e9f6020-9b73-4d31-9fc5-a93926852f61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:27.289058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2e9f6020-9b73-4d31-9fc5-a93926852f61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:27.295547 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e9f6020-9b73-4d31-9fc5-a93926852f61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:27.295999 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e9f6020-9b73-4d31-9fc5-a93926852f61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:27.297389 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e9f6020-9b73-4d31-9fc5-a93926852f61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:27.297828 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e9f6020-9b73-4d31-9fc5-a93926852f61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:27.439083 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2e9f6020-9b73-4d31-9fc5-a93926852f61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:27.446506 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2e9f6020-9b73-4d31-9fc5-a93926852f61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1267 microversion: 2.1 time: 0.161999 Jun 30 16:38:27.447082 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 324/651] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:27 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:28.465312 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-70181d08-61f0-49d2-9e2e-2512e8d2b7c8 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:28.466043 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-70181d08-61f0-49d2-9e2e-2512e8d2b7c8 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:28.472777 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-70181d08-61f0-49d2-9e2e-2512e8d2b7c8 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:28.473229 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-70181d08-61f0-49d2-9e2e-2512e8d2b7c8 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:28.473996 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-70181d08-61f0-49d2-9e2e-2512e8d2b7c8 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:28.474438 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-70181d08-61f0-49d2-9e2e-2512e8d2b7c8 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:28.606715 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-70181d08-61f0-49d2-9e2e-2512e8d2b7c8 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:28.615278 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-70181d08-61f0-49d2-9e2e-2512e8d2b7c8 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1267 microversion: 2.1 time: 0.155055 Jun 30 16:38:28.615862 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 328/652] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:28 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:29.632383 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-116e360f-052e-41a3-a271-7a35f1c16a8a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:29.633099 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-116e360f-052e-41a3-a271-7a35f1c16a8a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:29.642258 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-116e360f-052e-41a3-a271-7a35f1c16a8a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:29.642258 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-116e360f-052e-41a3-a271-7a35f1c16a8a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:29.642258 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-116e360f-052e-41a3-a271-7a35f1c16a8a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:29.642585 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-116e360f-052e-41a3-a271-7a35f1c16a8a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:29.778423 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-116e360f-052e-41a3-a271-7a35f1c16a8a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:29.786419 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-116e360f-052e-41a3-a271-7a35f1c16a8a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1267 microversion: 2.1 time: 0.157790 Jun 30 16:38:29.786996 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 325/653] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:29 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:30.803766 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f80885c6-ebf5-4875-a2fa-b63f82a1eb35 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:30.804652 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f80885c6-ebf5-4875-a2fa-b63f82a1eb35 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:30.813142 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f80885c6-ebf5-4875-a2fa-b63f82a1eb35 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:30.813667 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f80885c6-ebf5-4875-a2fa-b63f82a1eb35 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:30.814444 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f80885c6-ebf5-4875-a2fa-b63f82a1eb35 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:30.814892 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f80885c6-ebf5-4875-a2fa-b63f82a1eb35 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:30.955972 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f80885c6-ebf5-4875-a2fa-b63f82a1eb35 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:30.964515 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f80885c6-ebf5-4875-a2fa-b63f82a1eb35 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1267 microversion: 2.1 time: 0.163586 Jun 30 16:38:30.964515 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 329/654] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:30 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:31.979955 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4aade122-6043-42c8-9315-9eb0359460fb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:31.980559 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4aade122-6043-42c8-9315-9eb0359460fb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:31.987844 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4aade122-6043-42c8-9315-9eb0359460fb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:31.988292 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4aade122-6043-42c8-9315-9eb0359460fb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:31.989054 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4aade122-6043-42c8-9315-9eb0359460fb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:31.989481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4aade122-6043-42c8-9315-9eb0359460fb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:32.123874 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4aade122-6043-42c8-9315-9eb0359460fb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:32.131376 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-4aade122-6043-42c8-9315-9eb0359460fb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1267 microversion: 2.1 time: 0.155245 Jun 30 16:38:32.131974 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 326/655] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:31 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:33.100002 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-701602ee-ce64-4397-aa25-03f58e1eb963 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:33.100898 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-701602ee-ce64-4397-aa25-03f58e1eb963 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:33.107929 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-701602ee-ce64-4397-aa25-03f58e1eb963 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:33.108380 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-701602ee-ce64-4397-aa25-03f58e1eb963 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:33.109146 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-701602ee-ce64-4397-aa25-03f58e1eb963 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:33.109976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-701602ee-ce64-4397-aa25-03f58e1eb963 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:33.148502 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e3c80912-fa44-4777-9821-0c128f47c828 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:33.149328 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e3c80912-fa44-4777-9821-0c128f47c828 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:33.156517 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e3c80912-fa44-4777-9821-0c128f47c828 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:33.156974 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e3c80912-fa44-4777-9821-0c128f47c828 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:33.157760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e3c80912-fa44-4777-9821-0c128f47c828 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:33.158200 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e3c80912-fa44-4777-9821-0c128f47c828 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:33.203626 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-701602ee-ce64-4397-aa25-03f58e1eb963 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lazy-loading 'services' on Instance uuid 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:38:33.299162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-e3c80912-fa44-4777-9821-0c128f47c828 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:33.306868 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e3c80912-fa44-4777-9821-0c128f47c828 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1267 microversion: 2.1 time: 0.162377 Jun 30 16:38:33.307495 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 327/656] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:33 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:38:33.455368 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-701602ee-ce64-4397-aa25-03f58e1eb963 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b/os-volume_attachments/37572dd2-3afe-47a3-8f80-6bc140120ab1" status: 202 len: 0 microversion: 2.1 time: 0.362865 Jun 30 16:38:33.456026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 330/657] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 30 16:38:33 2022] DELETE /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b/os-volume_attachments/37572dd2-3afe-47a3-8f80-6bc140120ab1 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:38:34.323252 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8d4c999b-a9da-4828-857d-8f1b8462b6d3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:34.323902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8d4c999b-a9da-4828-857d-8f1b8462b6d3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:34.331219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d4c999b-a9da-4828-857d-8f1b8462b6d3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:34.331712 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d4c999b-a9da-4828-857d-8f1b8462b6d3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:34.332501 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d4c999b-a9da-4828-857d-8f1b8462b6d3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:34.332952 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d4c999b-a9da-4828-857d-8f1b8462b6d3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:34.473513 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8d4c999b-a9da-4828-857d-8f1b8462b6d3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:34.481055 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8d4c999b-a9da-4828-857d-8f1b8462b6d3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1267 microversion: 2.1 time: 0.161705 Jun 30 16:38:34.486739 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 328/658] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:34 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:34.583690 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-9e64a29a-cd57-4c8f-968f-f3b08c9bb085 req-3e43e7cf-090c-4f15-8e77-351e7e7d19cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cb685e-c960-41dc-89ad-bc5cabc56565", "name": "network-vif-plugged", "status": "completed", "tag": "2cf2d7d3-c6a6-4edb-8d6d-b8575a6abf8c"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:34.589801 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:34.593555 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-9e64a29a-cd57-4c8f-968f-f3b08c9bb085 req-3e43e7cf-090c-4f15-8e77-351e7e7d19cd service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:34.594346 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-9e64a29a-cd57-4c8f-968f-f3b08c9bb085 req-3e43e7cf-090c-4f15-8e77-351e7e7d19cd service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:34.605099 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-9e64a29a-cd57-4c8f-968f-f3b08c9bb085 req-3e43e7cf-090c-4f15-8e77-351e7e7d19cd service nova] Creating event network-vif-plugged:2cf2d7d3-c6a6-4edb-8d6d-b8575a6abf8c for instance d8cb685e-c960-41dc-89ad-bc5cabc56565 on hv-cinder-83602 Jun 30 16:38:34.610675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-9e64a29a-cd57-4c8f-968f-f3b08c9bb085 req-3e43e7cf-090c-4f15-8e77-351e7e7d19cd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032168 Jun 30 16:38:34.611460 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 331/659] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:38:35.498943 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3d8481e5-59d2-4447-baac-8557b944876b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:35.500637 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3d8481e5-59d2-4447-baac-8557b944876b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:35.507117 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3d8481e5-59d2-4447-baac-8557b944876b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:35.507606 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3d8481e5-59d2-4447-baac-8557b944876b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:35.508378 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3d8481e5-59d2-4447-baac-8557b944876b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:35.508820 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3d8481e5-59d2-4447-baac-8557b944876b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:35.636536 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ebb23611-dc98-4b82-b93a-baa9f1e86598 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:35.637776 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ebb23611-dc98-4b82-b93a-baa9f1e86598 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:35.646647 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ebb23611-dc98-4b82-b93a-baa9f1e86598 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:35.647426 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ebb23611-dc98-4b82-b93a-baa9f1e86598 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:35.648448 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ebb23611-dc98-4b82-b93a-baa9f1e86598 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:35.649088 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ebb23611-dc98-4b82-b93a-baa9f1e86598 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:35.652290 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3d8481e5-59d2-4447-baac-8557b944876b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:35.661312 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3d8481e5-59d2-4447-baac-8557b944876b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1267 microversion: 2.1 time: 0.166938 Jun 30 16:38:35.662286 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 329/660] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:35 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:35.679092 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ebb23611-dc98-4b82-b93a-baa9f1e86598 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Going to try to terminate instance {{(pid=124815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:38:35.981328 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ebb23611-dc98-4b82-b93a-baa9f1e86598 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "DELETE /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 204 len: 0 microversion: 2.1 time: 0.349515 Jun 30 16:38:35.981846 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 332/661] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:38:35 2022] DELETE /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:38:35.990457 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e1ebf4d0-eca3-46d6-8ab5-fd285473d523 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:35.991069 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e1ebf4d0-eca3-46d6-8ab5-fd285473d523 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:35.997458 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1ebf4d0-eca3-46d6-8ab5-fd285473d523 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:35.997977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1ebf4d0-eca3-46d6-8ab5-fd285473d523 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:35.998756 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1ebf4d0-eca3-46d6-8ab5-fd285473d523 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:35.999193 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1ebf4d0-eca3-46d6-8ab5-fd285473d523 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:36.141323 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-e1ebf4d0-eca3-46d6-8ab5-fd285473d523 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:36.149176 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e1ebf4d0-eca3-46d6-8ab5-fd285473d523 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1515 microversion: 2.1 time: 0.162803 Jun 30 16:38:36.149753 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 330/662] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:35 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:36.679490 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-635db82b-9ae6-4517-974c-4fe7189b1bd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:36.680450 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-635db82b-9ae6-4517-974c-4fe7189b1bd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:36.686795 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-635db82b-9ae6-4517-974c-4fe7189b1bd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:36.687239 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-635db82b-9ae6-4517-974c-4fe7189b1bd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:36.689225 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-635db82b-9ae6-4517-974c-4fe7189b1bd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:36.689660 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-635db82b-9ae6-4517-974c-4fe7189b1bd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:36.840455 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-635db82b-9ae6-4517-974c-4fe7189b1bd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:36.848595 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-635db82b-9ae6-4517-974c-4fe7189b1bd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1267 microversion: 2.1 time: 0.173290 Jun 30 16:38:36.849170 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 333/663] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:36 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:37.166248 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-b077c0f8-17da-458e-b9e0-138f7a295bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:37.166938 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-b077c0f8-17da-458e-b9e0-138f7a295bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:37.175402 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b077c0f8-17da-458e-b9e0-138f7a295bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:37.175884 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b077c0f8-17da-458e-b9e0-138f7a295bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:37.176669 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b077c0f8-17da-458e-b9e0-138f7a295bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:37.177108 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b077c0f8-17da-458e-b9e0-138f7a295bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:37.312808 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b077c0f8-17da-458e-b9e0-138f7a295bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:37.320401 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-b077c0f8-17da-458e-b9e0-138f7a295bd1 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1515 microversion: 2.1 time: 0.158051 Jun 30 16:38:37.320963 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 331/664] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:37 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:37.865543 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0d31a6a6-e793-4dcd-abee-9e9b7b4f65d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:37.866155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-0d31a6a6-e793-4dcd-abee-9e9b7b4f65d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:37.872882 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0d31a6a6-e793-4dcd-abee-9e9b7b4f65d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:37.877507 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0d31a6a6-e793-4dcd-abee-9e9b7b4f65d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:37.877507 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0d31a6a6-e793-4dcd-abee-9e9b7b4f65d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:37.877507 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0d31a6a6-e793-4dcd-abee-9e9b7b4f65d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:38.015871 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-0d31a6a6-e793-4dcd-abee-9e9b7b4f65d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:38.023522 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-0d31a6a6-e793-4dcd-abee-9e9b7b4f65d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1267 microversion: 2.1 time: 0.161909 Jun 30 16:38:38.024091 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 334/665] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:37 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:38.338337 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-20cb8a93-f5c0-4cd4-b383-a00421b818e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:38.338953 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-20cb8a93-f5c0-4cd4-b383-a00421b818e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:38.341341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=76 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:38.346854 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-20cb8a93-f5c0-4cd4-b383-a00421b818e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:38.347301 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-20cb8a93-f5c0-4cd4-b383-a00421b818e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:38.348158 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-20cb8a93-f5c0-4cd4-b383-a00421b818e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:38.348606 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-20cb8a93-f5c0-4cd4-b383-a00421b818e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:38.478540 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-20cb8a93-f5c0-4cd4-b383-a00421b818e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:38.486630 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-20cb8a93-f5c0-4cd4-b383-a00421b818e4 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1515 microversion: 2.1 time: 0.152180 Jun 30 16:38:38.487191 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 332/666] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:38 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:39.040344 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-46701827-a4f2-40b3-8ada-0c7d54627f6b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:39.041010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-46701827-a4f2-40b3-8ada-0c7d54627f6b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:39.048085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-46701827-a4f2-40b3-8ada-0c7d54627f6b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:39.048785 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-46701827-a4f2-40b3-8ada-0c7d54627f6b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:39.049330 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-46701827-a4f2-40b3-8ada-0c7d54627f6b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:39.049758 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-46701827-a4f2-40b3-8ada-0c7d54627f6b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:39.272755 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-46701827-a4f2-40b3-8ada-0c7d54627f6b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:39.280401 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-46701827-a4f2-40b3-8ada-0c7d54627f6b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1453 microversion: 2.1 time: 0.243891 Jun 30 16:38:39.280963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 335/667] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:39 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1453 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:39.296440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-73a5893b-f3ff-44e4-8e40-38e27f756e3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:39.297075 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-73a5893b-f3ff-44e4-8e40-38e27f756e3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:39.303160 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-73a5893b-f3ff-44e4-8e40-38e27f756e3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:39.303661 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-73a5893b-f3ff-44e4-8e40-38e27f756e3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:39.304426 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-73a5893b-f3ff-44e4-8e40-38e27f756e3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:39.304861 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-73a5893b-f3ff-44e4-8e40-38e27f756e3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:39.320367 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=100 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:39.502731 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-0e85c807-7a12-4696-8a17-cf3c2cec1e15 req-c9462b3a-f426-4272-b3b6-3b447979099e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b", "name": "network-vif-deleted", "tag": "a8b6c930-9dd0-4e31-b6d2-939648afc8ba"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:39.511759 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-0e85c807-7a12-4696-8a17-cf3c2cec1e15 req-c9462b3a-f426-4272-b3b6-3b447979099e service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:39.512574 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-0e85c807-7a12-4696-8a17-cf3c2cec1e15 req-c9462b3a-f426-4272-b3b6-3b447979099e service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:39.521332 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-73a5893b-f3ff-44e4-8e40-38e27f756e3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:39.524512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-0e85c807-7a12-4696-8a17-cf3c2cec1e15 req-c9462b3a-f426-4272-b3b6-3b447979099e service nova] Creating event network-vif-deleted:a8b6c930-9dd0-4e31-b6d2-939648afc8ba for instance 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b on hv-cinder-83602 Jun 30 16:38:39.529513 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-0e85c807-7a12-4696-8a17-cf3c2cec1e15 req-c9462b3a-f426-4272-b3b6-3b447979099e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033027 Jun 30 16:38:39.530114 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 336/668] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:38:39.530932 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-73a5893b-f3ff-44e4-8e40-38e27f756e3a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1453 microversion: 2.1 time: 0.237985 Jun 30 16:38:39.534155 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 333/669] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:39 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1453 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:39.535639 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-29fde930-04d7-4cf1-bfce-40a38ed96675 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:39.536333 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-29fde930-04d7-4cf1-bfce-40a38ed96675 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:39.545433 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-29fde930-04d7-4cf1-bfce-40a38ed96675 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:39.545953 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-29fde930-04d7-4cf1-bfce-40a38ed96675 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:39.546805 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-29fde930-04d7-4cf1-bfce-40a38ed96675 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:39.547837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-29fde930-04d7-4cf1-bfce-40a38ed96675 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:39.626373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-29fde930-04d7-4cf1-bfce-40a38ed96675 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:39.633570 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-29fde930-04d7-4cf1-bfce-40a38ed96675 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1473 microversion: 2.1 time: 0.102154 Jun 30 16:38:39.634067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 337/670] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:39 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1473 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:40.651285 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6b512d4b-3374-4df2-8f3f-e3090bed21f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:40.651936 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6b512d4b-3374-4df2-8f3f-e3090bed21f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:40.660487 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6b512d4b-3374-4df2-8f3f-e3090bed21f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:40.661010 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6b512d4b-3374-4df2-8f3f-e3090bed21f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:40.662714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6b512d4b-3374-4df2-8f3f-e3090bed21f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:40.662714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6b512d4b-3374-4df2-8f3f-e3090bed21f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:40.697444 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6b512d4b-3374-4df2-8f3f-e3090bed21f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:40.697898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6b512d4b-3374-4df2-8f3f-e3090bed21f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:40.698352 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-6b512d4b-3374-4df2-8f3f-e3090bed21f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lazy-loading 'fault' on Instance uuid 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:38:40.740796 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6b512d4b-3374-4df2-8f3f-e3090bed21f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d7af5479ce46b99e333d91128b826e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df4c3aa7c8044dcbd46064e0e495a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:40.748641 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6b512d4b-3374-4df2-8f3f-e3090bed21f0 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 200 len: 1309 microversion: 2.1 time: 0.102246 Jun 30 16:38:40.749211 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 334/671] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:40 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:41.672872 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-e67eee34-05bc-43e2-baa4-d835ca05e2df req-9800ea8e-8097-4aff-8225-47e4920e166b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8cb685e-c960-41dc-89ad-bc5cabc56565", "tag": "2cf2d7d3-c6a6-4edb-8d6d-b8575a6abf8c"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:41.682429 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-e67eee34-05bc-43e2-baa4-d835ca05e2df req-9800ea8e-8097-4aff-8225-47e4920e166b service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:41.682910 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-e67eee34-05bc-43e2-baa4-d835ca05e2df req-9800ea8e-8097-4aff-8225-47e4920e166b service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:41.696076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-e67eee34-05bc-43e2-baa4-d835ca05e2df req-9800ea8e-8097-4aff-8225-47e4920e166b service nova] Creating event network-changed:2cf2d7d3-c6a6-4edb-8d6d-b8575a6abf8c for instance d8cb685e-c960-41dc-89ad-bc5cabc56565 on hv-cinder-83602 Jun 30 16:38:41.701201 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-e67eee34-05bc-43e2-baa4-d835ca05e2df req-9800ea8e-8097-4aff-8225-47e4920e166b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032778 Jun 30 16:38:41.702020 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 338/672] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:38:41.774416 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-29b5807a-1d8a-4c16-b56f-601ee5b5db05 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:41.775067 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-29b5807a-1d8a-4c16-b56f-601ee5b5db05 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] [instance: 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:41.781227 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-29b5807a-1d8a-4c16-b56f-601ee5b5db05 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:41.783272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-29b5807a-1d8a-4c16-b56f-601ee5b5db05 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:41.784076 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-29b5807a-1d8a-4c16-b56f-601ee5b5db05 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:41.784530 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-29b5807a-1d8a-4c16-b56f-601ee5b5db05 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-29b5807a-1d8a-4c16-b56f-601ee5b5db05 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] HTTP exception thrown: Instance 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b could not be found. Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-29b5807a-1d8a-4c16-b56f-601ee5b5db05 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Request method failure captured: Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b HTTP/1.1 Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdDstG7FtaZjuck8CZSgzel5KlA1Ns-og4bFYD1M-TM6R6yTU_Waj7zQSKjJom8tTD8WIfQtJkeh-EqNf8BYq1CRCjrx2AYntIoolU5HyFSgflRElRvsU9BNpT43pKjAYdaHwyF2xJ0NbaWGQFl4XEwb5Nb9eMSQAJ2gnBp1OWWPkak Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 4df4c3aa7c8044dcbd46064e0e495a84 Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-VolumesSnapshotTestJSON-307117237 Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:38:41.806977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:38:41.808499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4df4c3aa7c8044dcbd46064e0e495a84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4df4c3aa7c8044dcbd46064e0e495a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4df4c3aa7c8044dcbd46064e0e495a84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4df4c3aa7c8044dcbd46064e0e495a84"}]}] Jun 30 16:38:41.808499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-VolumesSnapshotTestJSON-307117237 Jun 30 16:38:41.808499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 4df4c3aa7c8044dcbd46064e0e495a84 Jun 30 16:38:41.808499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-307117237 Jun 30 16:38:41.808499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-VolumesSnapshotTestJSON-307117237-project Jun 30 16:38:41.808499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:38:41.808499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:38:41.808499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 96d7af5479ce46b99e333d91128b826e Jun 30 16:38:41.808499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-VolumesSnapshotTestJSON-307117237-project Jun 30 16:38:41.808499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:38:41.808499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b could not be found. Jun 30 16:38:41.808499 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': '3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b'} Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b could not be found. Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:38:41.809251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b could not be found. Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b could not be found. Jun 30 16:38:41.810452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:38:41.811563 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-29b5807a-1d8a-4c16-b56f-601ee5b5db05 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] Returning 404 to user: Instance 3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:38:41.811563 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-29b5807a-1d8a-4c16-b56f-601ee5b5db05 tempest-VolumesSnapshotTestJSON-307117237 tempest-VolumesSnapshotTestJSON-307117237-project] 10.222.0.67 "GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b" status: 404 len: 111 microversion: 2.1 time: 0.032686 Jun 30 16:38:41.811563 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 335/673] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:38:41 2022] GET /compute/v2.1/servers/3d783a6f-0cf4-42ba-a5a1-3ffc0f324a7b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:38:47.340590 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b64579b6-0ee0-40ac-b358-39cc0290d510 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:47.341641 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b64579b6-0ee0-40ac-b358-39cc0290d510 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:47.354164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b64579b6-0ee0-40ac-b358-39cc0290d510 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:47.354943 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b64579b6-0ee0-40ac-b358-39cc0290d510 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:47.356378 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b64579b6-0ee0-40ac-b358-39cc0290d510 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:47.357164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b64579b6-0ee0-40ac-b358-39cc0290d510 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:47.402122 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b64579b6-0ee0-40ac-b358-39cc0290d510 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/os-volume_attachments/89e81406-5b4b-4ae8-a0c7-3ea85c0a4fc5" status: 200 len: 194 microversion: 2.20 time: 0.069941 Jun 30 16:38:47.403515 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 339/674] 10.222.0.67 () {60 vars in 1453 bytes} [Thu Jun 30 16:38:47 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/os-volume_attachments/89e81406-5b4b-4ae8-a0c7-3ea85c0a4fc5 => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:38:47.486047 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e23b320f-6b2b-4947-9459-c99d55458a9e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:47.487676 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e23b320f-6b2b-4947-9459-c99d55458a9e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:47.497871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e23b320f-6b2b-4947-9459-c99d55458a9e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:47.498326 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e23b320f-6b2b-4947-9459-c99d55458a9e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:47.499280 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e23b320f-6b2b-4947-9459-c99d55458a9e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:47.499883 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e23b320f-6b2b-4947-9459-c99d55458a9e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:47.823622 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-e23b320f-6b2b-4947-9459-c99d55458a9e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lazy-loading 'services' on Instance uuid ab1f1412-017f-448b-a6bb-21d09d668a46 {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:38:48.075589 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e23b320f-6b2b-4947-9459-c99d55458a9e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/os-volume_attachments/89e81406-5b4b-4ae8-a0c7-3ea85c0a4fc5" status: 202 len: 0 microversion: 2.20 time: 0.596667 Jun 30 16:38:48.076190 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 336/675] 10.222.0.67 () {60 vars in 1456 bytes} [Thu Jun 30 16:38:47 2022] DELETE /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/os-volume_attachments/89e81406-5b4b-4ae8-a0c7-3ea85c0a4fc5 => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:38:48.086804 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-07a9e0f0-e7dc-4c15-98e6-7377681da286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:48.087776 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-07a9e0f0-e7dc-4c15-98e6-7377681da286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:48.097240 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-07a9e0f0-e7dc-4c15-98e6-7377681da286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:48.098891 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-07a9e0f0-e7dc-4c15-98e6-7377681da286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:48.098891 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-07a9e0f0-e7dc-4c15-98e6-7377681da286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:48.099311 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-07a9e0f0-e7dc-4c15-98e6-7377681da286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:48.138972 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-07a9e0f0-e7dc-4c15-98e6-7377681da286 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057132 Jun 30 16:38:48.139822 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 340/676] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Jun 30 16:38:48 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:38:49.151718 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-72bbc36f-8ff0-4f92-81c0-b690a9491ff9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:49.152875 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-72bbc36f-8ff0-4f92-81c0-b690a9491ff9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:49.159491 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-72bbc36f-8ff0-4f92-81c0-b690a9491ff9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:49.159956 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-72bbc36f-8ff0-4f92-81c0-b690a9491ff9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:49.160746 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-72bbc36f-8ff0-4f92-81c0-b690a9491ff9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:49.161184 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-72bbc36f-8ff0-4f92-81c0-b690a9491ff9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:49.194181 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-72bbc36f-8ff0-4f92-81c0-b690a9491ff9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047369 Jun 30 16:38:49.194756 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 337/677] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Jun 30 16:38:49 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:38:50.206928 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-dde55061-3fb9-40fa-9eda-e78e73b63283 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:50.207881 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-dde55061-3fb9-40fa-9eda-e78e73b63283 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:50.214541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dde55061-3fb9-40fa-9eda-e78e73b63283 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:50.214990 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dde55061-3fb9-40fa-9eda-e78e73b63283 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:50.215807 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dde55061-3fb9-40fa-9eda-e78e73b63283 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:50.216251 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dde55061-3fb9-40fa-9eda-e78e73b63283 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:50.248193 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-dde55061-3fb9-40fa-9eda-e78e73b63283 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044963 Jun 30 16:38:50.249228 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 341/678] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Jun 30 16:38:50 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:38:50.310857 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-32668d43-248b-4da8-9a2a-08c29a0e7d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:50.311451 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-32668d43-248b-4da8-9a2a-08c29a0e7d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:50.318256 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-32668d43-248b-4da8-9a2a-08c29a0e7d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:50.318706 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-32668d43-248b-4da8-9a2a-08c29a0e7d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:50.319507 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-32668d43-248b-4da8-9a2a-08c29a0e7d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:50.319959 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-32668d43-248b-4da8-9a2a-08c29a0e7d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:50.346697 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-32668d43-248b-4da8-9a2a-08c29a0e7d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Going to try to terminate instance {{(pid=124814) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:38:50.669134 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-32668d43-248b-4da8-9a2a-08c29a0e7d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 204 len: 0 microversion: 2.20 time: 0.361836 Jun 30 16:38:50.669913 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 338/679] 10.222.0.67 () {60 vars in 1279 bytes} [Thu Jun 30 16:38:50 2022] DELETE /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 16:38:50.684361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-44cf5603-4a52-4880-9fc5-3d0172fbc2bc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:50.684984 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-44cf5603-4a52-4880-9fc5-3d0172fbc2bc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:50.693430 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-44cf5603-4a52-4880-9fc5-3d0172fbc2bc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:50.694320 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-44cf5603-4a52-4880-9fc5-3d0172fbc2bc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:50.695174 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-44cf5603-4a52-4880-9fc5-3d0172fbc2bc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:50.695801 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-44cf5603-4a52-4880-9fc5-3d0172fbc2bc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:50.925611 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-44cf5603-4a52-4880-9fc5-3d0172fbc2bc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:50.935403 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-44cf5603-4a52-4880-9fc5-3d0172fbc2bc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:50.936956 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-44cf5603-4a52-4880-9fc5-3d0172fbc2bc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:50.938299 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-44cf5603-4a52-4880-9fc5-3d0172fbc2bc tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1723 microversion: 2.20 time: 0.258238 Jun 30 16:38:50.938953 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 342/680] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:38:50 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:38:51.959923 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-197e650e-fc4d-4b11-bf6c-bd5c8f4238cd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:51.960720 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-197e650e-fc4d-4b11-bf6c-bd5c8f4238cd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:51.969298 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-197e650e-fc4d-4b11-bf6c-bd5c8f4238cd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:51.969864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-197e650e-fc4d-4b11-bf6c-bd5c8f4238cd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:51.971633 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-197e650e-fc4d-4b11-bf6c-bd5c8f4238cd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:51.972268 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-197e650e-fc4d-4b11-bf6c-bd5c8f4238cd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:52.129447 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-197e650e-fc4d-4b11-bf6c-bd5c8f4238cd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:52.139617 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-197e650e-fc4d-4b11-bf6c-bd5c8f4238cd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:52.141142 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-197e650e-fc4d-4b11-bf6c-bd5c8f4238cd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:52.142924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-197e650e-fc4d-4b11-bf6c-bd5c8f4238cd tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1723 microversion: 2.20 time: 0.188174 Jun 30 16:38:52.143600 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 339/681] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:38:51 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:38:53.163840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b24a5f96-f63a-4a98-9f8a-c31391a1a19e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:53.165049 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b24a5f96-f63a-4a98-9f8a-c31391a1a19e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:53.173309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b24a5f96-f63a-4a98-9f8a-c31391a1a19e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:53.173782 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b24a5f96-f63a-4a98-9f8a-c31391a1a19e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:53.174655 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b24a5f96-f63a-4a98-9f8a-c31391a1a19e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:53.175102 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b24a5f96-f63a-4a98-9f8a-c31391a1a19e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:53.739573 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b24a5f96-f63a-4a98-9f8a-c31391a1a19e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:53.748723 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b24a5f96-f63a-4a98-9f8a-c31391a1a19e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:53.750313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b24a5f96-f63a-4a98-9f8a-c31391a1a19e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:53.752208 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b24a5f96-f63a-4a98-9f8a-c31391a1a19e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1723 microversion: 2.20 time: 0.592416 Jun 30 16:38:53.752825 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 343/682] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:38:53 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1723 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:38:54.471830 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-6b03da35-a2ac-4a41-9530-baa9dc01ee36 req-23bd36c8-3150-4ce7-ae4c-ccec8cbaf3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab1f1412-017f-448b-a6bb-21d09d668a46", "name": "network-vif-deleted", "tag": "feb9d98a-c1aa-45cf-b1e3-06597d656e69"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:38:54.480702 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-6b03da35-a2ac-4a41-9530-baa9dc01ee36 req-23bd36c8-3150-4ce7-ae4c-ccec8cbaf3f5 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:54.481152 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-6b03da35-a2ac-4a41-9530-baa9dc01ee36 req-23bd36c8-3150-4ce7-ae4c-ccec8cbaf3f5 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:54.496927 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-6b03da35-a2ac-4a41-9530-baa9dc01ee36 req-23bd36c8-3150-4ce7-ae4c-ccec8cbaf3f5 service nova] Creating event network-vif-deleted:feb9d98a-c1aa-45cf-b1e3-06597d656e69 for instance ab1f1412-017f-448b-a6bb-21d09d668a46 on hv-cinder-83602 Jun 30 16:38:54.511319 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-6b03da35-a2ac-4a41-9530-baa9dc01ee36 req-23bd36c8-3150-4ce7-ae4c-ccec8cbaf3f5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038019 Jun 30 16:38:54.511319 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 340/683] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:38:54.770779 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-07beb47b-07f7-4492-ad62-b319d277482a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:54.771435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-07beb47b-07f7-4492-ad62-b319d277482a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:54.778266 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-07beb47b-07f7-4492-ad62-b319d277482a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:54.778720 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-07beb47b-07f7-4492-ad62-b319d277482a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:54.779528 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-07beb47b-07f7-4492-ad62-b319d277482a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:54.779970 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-07beb47b-07f7-4492-ad62-b319d277482a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:54.783518 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:38:54.815750 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-07beb47b-07f7-4492-ad62-b319d277482a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:54.816182 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-07beb47b-07f7-4492-ad62-b319d277482a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:54.816649 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-07beb47b-07f7-4492-ad62-b319d277482a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lazy-loading 'fault' on Instance uuid ab1f1412-017f-448b-a6bb-21d09d668a46 {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:38:54.865045 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-07beb47b-07f7-4492-ad62-b319d277482a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:54.873632 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-07beb47b-07f7-4492-ad62-b319d277482a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:54.875215 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-07beb47b-07f7-4492-ad62-b319d277482a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:54.876428 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-07beb47b-07f7-4492-ad62-b319d277482a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1371 microversion: 2.20 time: 0.109848 Jun 30 16:38:54.877001 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 344/684] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:38:54 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:38:55.896253 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-39fc7563-a165-427e-9a8b-d353d9ca4813 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:55.897000 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-39fc7563-a165-427e-9a8b-d353d9ca4813 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:55.903332 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-39fc7563-a165-427e-9a8b-d353d9ca4813 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:55.903814 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-39fc7563-a165-427e-9a8b-d353d9ca4813 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:55.904593 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-39fc7563-a165-427e-9a8b-d353d9ca4813 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:55.905034 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-39fc7563-a165-427e-9a8b-d353d9ca4813 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:55.936417 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-39fc7563-a165-427e-9a8b-d353d9ca4813 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:55.936868 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-39fc7563-a165-427e-9a8b-d353d9ca4813 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:55.937355 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-39fc7563-a165-427e-9a8b-d353d9ca4813 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lazy-loading 'fault' on Instance uuid ab1f1412-017f-448b-a6bb-21d09d668a46 {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:38:55.979084 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-39fc7563-a165-427e-9a8b-d353d9ca4813 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:55.987465 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-39fc7563-a165-427e-9a8b-d353d9ca4813 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:55.989067 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-39fc7563-a165-427e-9a8b-d353d9ca4813 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:55.990203 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-39fc7563-a165-427e-9a8b-d353d9ca4813 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1371 microversion: 2.20 time: 0.099646 Jun 30 16:38:55.990762 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 341/685] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:38:55 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:38:57.009517 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b029d393-a004-45ea-8aae-445765186c7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:57.010110 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b029d393-a004-45ea-8aae-445765186c7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:57.017127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b029d393-a004-45ea-8aae-445765186c7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:57.017580 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b029d393-a004-45ea-8aae-445765186c7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:57.019040 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b029d393-a004-45ea-8aae-445765186c7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:57.019614 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b029d393-a004-45ea-8aae-445765186c7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:57.051584 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b029d393-a004-45ea-8aae-445765186c7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:57.051937 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b029d393-a004-45ea-8aae-445765186c7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:57.052388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-b029d393-a004-45ea-8aae-445765186c7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lazy-loading 'fault' on Instance uuid ab1f1412-017f-448b-a6bb-21d09d668a46 {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:38:57.096422 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b029d393-a004-45ea-8aae-445765186c7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:57.104489 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b029d393-a004-45ea-8aae-445765186c7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:57.106117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b029d393-a004-45ea-8aae-445765186c7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:57.107275 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b029d393-a004-45ea-8aae-445765186c7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1371 microversion: 2.20 time: 0.102256 Jun 30 16:38:57.107867 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 345/686] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:38:57 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:38:58.126430 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6d530091-c84c-4fec-8dfb-99cdc7302f56 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:58.127138 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6d530091-c84c-4fec-8dfb-99cdc7302f56 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:58.134535 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d530091-c84c-4fec-8dfb-99cdc7302f56 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:58.135098 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d530091-c84c-4fec-8dfb-99cdc7302f56 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:58.135919 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d530091-c84c-4fec-8dfb-99cdc7302f56 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:58.136371 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d530091-c84c-4fec-8dfb-99cdc7302f56 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:58.169161 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d530091-c84c-4fec-8dfb-99cdc7302f56 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:58.169607 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d530091-c84c-4fec-8dfb-99cdc7302f56 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:58.170056 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-6d530091-c84c-4fec-8dfb-99cdc7302f56 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lazy-loading 'fault' on Instance uuid ab1f1412-017f-448b-a6bb-21d09d668a46 {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:38:58.213303 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6d530091-c84c-4fec-8dfb-99cdc7302f56 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:58.222077 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6d530091-c84c-4fec-8dfb-99cdc7302f56 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:58.223660 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6d530091-c84c-4fec-8dfb-99cdc7302f56 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:38:58.224850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6d530091-c84c-4fec-8dfb-99cdc7302f56 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 200 len: 1371 microversion: 2.20 time: 0.102499 Jun 30 16:38:58.225405 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 342/687] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:38:58 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 1371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:38:59.242758 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f26cf412-2808-4924-8e2b-b361834cdf87 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:59.243497 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f26cf412-2808-4924-8e2b-b361834cdf87 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:38:59.250295 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f26cf412-2808-4924-8e2b-b361834cdf87 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:59.250748 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f26cf412-2808-4924-8e2b-b361834cdf87 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:59.251549 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f26cf412-2808-4924-8e2b-b361834cdf87 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:38:59.251995 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f26cf412-2808-4924-8e2b-b361834cdf87 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:38:59.267792 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-f26cf412-2808-4924-8e2b-b361834cdf87 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] HTTP exception thrown: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f26cf412-2808-4924-8e2b-b361834cdf87 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Request method failure captured: Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 HTTP/1.1 Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdB6pKkSiFMb9j8N2I1bvvoImAeLsPz1K9QWyduTWRb-4VYgk1oINrSfuHlnizwWrxwJ4yObhLLv2Oge6HLhJsAE2K-oaNzIwWPf7oF0D4Qz-bz3DCeieqS4gc3uF_tPD28lmGbAitU35378iWLCG_ZaPFRDf3eptPMSN6bKHO9iWjM Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: b66c389f8c5a47b2b97819e449c64ba0 Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:38:59.270446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:38:59.272052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b66c389f8c5a47b2b97819e449c64ba0"}]}] Jun 30 16:38:59.272052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:38:59.272052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: b66c389f8c5a47b2b97819e449c64ba0 Jun 30 16:38:59.272052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:38:59.272052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeShelveTestJSON-53036211-project Jun 30 16:38:59.272052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:38:59.272052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:38:59.272052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 7261ab46436e4546b8331aa8387cfa1c Jun 30 16:38:59.272052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeShelveTestJSON-53036211-project Jun 30 16:38:59.272052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:38:59.272052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:38:59.272052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'ab1f1412-017f-448b-a6bb-21d09d668a46'} Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:38:59.272899 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:38:59.274421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:38:59.275831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f26cf412-2808-4924-8e2b-b361834cdf87 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Returning 404 to user: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:38:59.275831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f26cf412-2808-4924-8e2b-b361834cdf87 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 404 len: 111 microversion: 2.20 time: 0.033139 Jun 30 16:38:59.275831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 346/688] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:38:59 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 16:38:59.282554 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e3591eaa-bc75-43c5-a995-6baa200e8ee0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '.version_select at 0x7f382017d3a0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:38:59.400531 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e3591eaa-bc75-43c5-a995-6baa200e8ee0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011843947" status: 204 len: 0 microversion: 2.20 time: 0.121832 Jun 30 16:38:59.401120 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 343/689] 10.222.0.67 () {60 vars in 1261 bytes} [Thu Jun 30 16:38:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011843947 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 16:39:00.284841 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-5d71070c-1cc3-4a2b-9ff3-ddbede04d033 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Action: 'create', calling method: .version_select at 0x7f3820097b80>, body: {"keypair": {"name": "tempest-keypair-1629430661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuuxc6DdWaL2qLaN1x+FDtoj6RRMNHd4HcZ4mxDJ+HvzM5k/rys2uGo6DGQCPDbHLbMWt7wYhwVIoWYKktq7dVugzF5HxQ/f+OtgwkdPzB8LoL7GzqDXlnFIeujq+81hA=="}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:00.299268 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-5d71070c-1cc3-4a2b-9ff3-ddbede04d033 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Getting quotas for project b66c389f8c5a47b2b97819e449c64ba0. Resources: {'key_pairs'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:39:00.303839 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-5d71070c-1cc3-4a2b-9ff3-ddbede04d033 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Getting quotas for user 7261ab46436e4546b8331aa8387cfa1c and project b66c389f8c5a47b2b97819e449c64ba0. Resources: {'key_pairs'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:39:00.396692 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-5d71070c-1cc3-4a2b-9ff3-ddbede04d033 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.116059 Jun 30 16:39:00.397206 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 347/690] 10.222.0.67 () {62 vars in 1199 bytes} [Thu Jun 30 16:39:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 30 16:39:02.840359 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1525034777", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93a4e560-3e75-48b5-b797-80cbf95a4a78"}], "security_groups": [{"name": "tempest-securitygroup--856779126"}], "key_name": "tempest-keypair-1629430661", "user_data": "}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:02.948339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.network.neutron [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] validate_networks() for [('93a4e560-3e75-48b5-b797-80cbf95a4a78', None, None, None, None, None)] {{(pid=124814) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:39:03.459036 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Flavor limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:39:03.459457 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Image limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:39:03.459980 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Flavor pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:39:03.460444 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Image pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:39:03.460850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:39:03.469991 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:03.470438 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:03.471228 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:03.471699 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:03.492591 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Getting quotas for project b66c389f8c5a47b2b97819e449c64ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:39:03.496880 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Getting quotas for user 7261ab46436e4546b8331aa8387cfa1c and project b66c389f8c5a47b2b97819e449c64ba0. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:39:03.509487 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Going to run 1 instances... {{(pid=124814) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:39:03.511908 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:39:03.710718 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c8bc1cc3-b608-4a24-95c6-ea3aad650f80 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.875330 Jun 30 16:39:03.711284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 344/691] 10.222.0.67 () {62 vars in 1187 bytes} [Thu Jun 30 16:39:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 30 16:39:03.722283 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c8a9a94a-5bd2-4cad-8c8c-37eb76eb970e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:03.723184 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c8a9a94a-5bd2-4cad-8c8c-37eb76eb970e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:03.781796 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c8a9a94a-5bd2-4cad-8c8c-37eb76eb970e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:03.790512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c8a9a94a-5bd2-4cad-8c8c-37eb76eb970e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:03.792229 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c8a9a94a-5bd2-4cad-8c8c-37eb76eb970e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:03.795344 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c8a9a94a-5bd2-4cad-8c8c-37eb76eb970e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1282 microversion: 2.20 time: 0.075816 Jun 30 16:39:03.795344 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 348/692] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:03 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:39:04.812779 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2e63f9fe-5b8d-43e2-a4f9-7d9f9f7b1a57 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:04.813445 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2e63f9fe-5b8d-43e2-a4f9-7d9f9f7b1a57 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:04.821943 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e63f9fe-5b8d-43e2-a4f9-7d9f9f7b1a57 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:04.824314 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e63f9fe-5b8d-43e2-a4f9-7d9f9f7b1a57 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:04.824314 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e63f9fe-5b8d-43e2-a4f9-7d9f9f7b1a57 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:04.824314 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e63f9fe-5b8d-43e2-a4f9-7d9f9f7b1a57 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:04.894249 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2e63f9fe-5b8d-43e2-a4f9-7d9f9f7b1a57 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:04.904069 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2e63f9fe-5b8d-43e2-a4f9-7d9f9f7b1a57 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:04.905957 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2e63f9fe-5b8d-43e2-a4f9-7d9f9f7b1a57 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:04.907332 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2e63f9fe-5b8d-43e2-a4f9-7d9f9f7b1a57 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1286 microversion: 2.20 time: 0.098924 Jun 30 16:39:04.907931 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 345/693] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:04 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:39:05.927732 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e7596cad-77e3-4244-b2b0-8eed1dde68ce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:05.928408 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e7596cad-77e3-4244-b2b0-8eed1dde68ce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:05.931105 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:05.936590 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e7596cad-77e3-4244-b2b0-8eed1dde68ce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:05.937041 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e7596cad-77e3-4244-b2b0-8eed1dde68ce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:05.937820 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e7596cad-77e3-4244-b2b0-8eed1dde68ce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:05.938256 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e7596cad-77e3-4244-b2b0-8eed1dde68ce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:06.006919 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e7596cad-77e3-4244-b2b0-8eed1dde68ce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:06.016039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e7596cad-77e3-4244-b2b0-8eed1dde68ce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:06.017567 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e7596cad-77e3-4244-b2b0-8eed1dde68ce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:06.018693 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e7596cad-77e3-4244-b2b0-8eed1dde68ce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1334 microversion: 2.20 time: 0.096193 Jun 30 16:39:06.019265 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 349/694] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:05 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:39:07.039755 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9368e02d-5b0c-401c-b883-5385fed0caa7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:07.040849 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9368e02d-5b0c-401c-b883-5385fed0caa7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:07.049726 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9368e02d-5b0c-401c-b883-5385fed0caa7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:07.050280 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9368e02d-5b0c-401c-b883-5385fed0caa7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:07.051351 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9368e02d-5b0c-401c-b883-5385fed0caa7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:07.052048 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9368e02d-5b0c-401c-b883-5385fed0caa7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:07.139003 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9368e02d-5b0c-401c-b883-5385fed0caa7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:07.144250 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9368e02d-5b0c-401c-b883-5385fed0caa7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:07.146903 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9368e02d-5b0c-401c-b883-5385fed0caa7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:07.147650 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9368e02d-5b0c-401c-b883-5385fed0caa7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1340 microversion: 2.20 time: 0.113350 Jun 30 16:39:07.148210 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 346/695] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:07 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1340 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:39:08.173704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ff48143b-05dd-49fb-894e-e4d2232c566e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:08.175237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ff48143b-05dd-49fb-894e-e4d2232c566e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:08.187024 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ff48143b-05dd-49fb-894e-e4d2232c566e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:08.187883 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ff48143b-05dd-49fb-894e-e4d2232c566e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:08.189931 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ff48143b-05dd-49fb-894e-e4d2232c566e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:08.191061 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ff48143b-05dd-49fb-894e-e4d2232c566e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:08.397520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ff48143b-05dd-49fb-894e-e4d2232c566e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:08.416582 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ff48143b-05dd-49fb-894e-e4d2232c566e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:08.419545 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ff48143b-05dd-49fb-894e-e4d2232c566e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:08.419545 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ff48143b-05dd-49fb-894e-e4d2232c566e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1407 microversion: 2.20 time: 0.252657 Jun 30 16:39:08.420275 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 350/696] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:08 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:39:08.464703 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-d3b67b7f-51a1-401b-93ba-a602a525d5a5 req-40af514f-e7a5-408f-b7ef-faf3db4ff0de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e41d57-839c-4b6e-8215-d67d1d428958", "tag": "cef899ca-3465-4288-82e5-31385d9c468b"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:08.467383 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:08.479109 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-d3b67b7f-51a1-401b-93ba-a602a525d5a5 req-40af514f-e7a5-408f-b7ef-faf3db4ff0de service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:08.479597 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-d3b67b7f-51a1-401b-93ba-a602a525d5a5 req-40af514f-e7a5-408f-b7ef-faf3db4ff0de service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:08.496046 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-d3b67b7f-51a1-401b-93ba-a602a525d5a5 req-40af514f-e7a5-408f-b7ef-faf3db4ff0de service nova] Creating event network-changed:cef899ca-3465-4288-82e5-31385d9c468b for instance 50e41d57-839c-4b6e-8215-d67d1d428958 on hv-cinder-83602 Jun 30 16:39:08.501455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-d3b67b7f-51a1-401b-93ba-a602a525d5a5 req-40af514f-e7a5-408f-b7ef-faf3db4ff0de service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051462 Jun 30 16:39:08.502655 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 347/697] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:09.453079 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9601dbab-364c-46f5-8958-efa5b0c19e19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:09.455189 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9601dbab-364c-46f5-8958-efa5b0c19e19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:09.472303 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9601dbab-364c-46f5-8958-efa5b0c19e19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:09.472954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9601dbab-364c-46f5-8958-efa5b0c19e19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:09.475047 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9601dbab-364c-46f5-8958-efa5b0c19e19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:09.475642 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9601dbab-364c-46f5-8958-efa5b0c19e19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:09.486823 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-28559f9d-e710-493a-8139-c13794b2db02 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:09.488170 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-28559f9d-e710-493a-8139-c13794b2db02 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:09.500078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-28559f9d-e710-493a-8139-c13794b2db02 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:09.500983 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-28559f9d-e710-493a-8139-c13794b2db02 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:09.506175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-28559f9d-e710-493a-8139-c13794b2db02 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:09.506175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-28559f9d-e710-493a-8139-c13794b2db02 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:09.506952 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:09.537272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-28559f9d-e710-493a-8139-c13794b2db02 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056335 Jun 30 16:39:09.538107 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 348/698] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:39:09 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 16:39:09.602029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-65aa6710-bca5-4fb8-8663-7c60622c91b5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:09.602819 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-65aa6710-bca5-4fb8-8663-7c60622c91b5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:09.610706 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-65aa6710-bca5-4fb8-8663-7c60622c91b5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:09.611172 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-65aa6710-bca5-4fb8-8663-7c60622c91b5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:09.611999 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-65aa6710-bca5-4fb8-8663-7c60622c91b5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:09.612441 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-65aa6710-bca5-4fb8-8663-7c60622c91b5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:09.642143 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-65aa6710-bca5-4fb8-8663-7c60622c91b5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Going to try to terminate instance {{(pid=124814) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:39:09.694047 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9601dbab-364c-46f5-8958-efa5b0c19e19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:09.703040 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9601dbab-364c-46f5-8958-efa5b0c19e19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:09.705847 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9601dbab-364c-46f5-8958-efa5b0c19e19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:09.707227 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9601dbab-364c-46f5-8958-efa5b0c19e19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1407 microversion: 2.20 time: 0.269556 Jun 30 16:39:09.707900 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 351/699] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:09 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1407 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:39:09.977411 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-65aa6710-bca5-4fb8-8663-7c60622c91b5 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "DELETE /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 204 len: 0 microversion: 2.1 time: 0.379965 Jun 30 16:39:09.978003 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 349/700] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:39:09 2022] DELETE /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 16:39:09.986311 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9f7a0072-ded4-43ec-b161-ad974d798a81 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:09.986925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9f7a0072-ded4-43ec-b161-ad974d798a81 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:09.994467 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9f7a0072-ded4-43ec-b161-ad974d798a81 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:09.994880 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9f7a0072-ded4-43ec-b161-ad974d798a81 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:09.995934 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9f7a0072-ded4-43ec-b161-ad974d798a81 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:09.996416 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9f7a0072-ded4-43ec-b161-ad974d798a81 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:10.226821 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9f7a0072-ded4-43ec-b161-ad974d798a81 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:10.240460 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9f7a0072-ded4-43ec-b161-ad974d798a81 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1672 microversion: 2.1 time: 0.256898 Jun 30 16:39:10.241516 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 352/701] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:09 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1672 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:10.513717 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-78f2f3f6-9e9e-43b3-8416-3c9247658515 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:10.516749 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-78f2f3f6-9e9e-43b3-8416-3c9247658515 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:10.527042 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-78f2f3f6-9e9e-43b3-8416-3c9247658515 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:10.527864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-78f2f3f6-9e9e-43b3-8416-3c9247658515 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:10.529042 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-78f2f3f6-9e9e-43b3-8416-3c9247658515 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:10.529624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-78f2f3f6-9e9e-43b3-8416-3c9247658515 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:10.629039 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-78f2f3f6-9e9e-43b3-8416-3c9247658515 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lazy-loading 'services' on Instance uuid d786bea4-1a92-4eaf-8450-f69f05986687 {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:39:10.726993 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d2017587-ecb4-4f29-93c1-68ec1949ee43 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:10.727709 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d2017587-ecb4-4f29-93c1-68ec1949ee43 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:10.734932 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d2017587-ecb4-4f29-93c1-68ec1949ee43 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:10.735419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d2017587-ecb4-4f29-93c1-68ec1949ee43 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:10.736263 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d2017587-ecb4-4f29-93c1-68ec1949ee43 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:10.736751 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d2017587-ecb4-4f29-93c1-68ec1949ee43 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:10.895352 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d2017587-ecb4-4f29-93c1-68ec1949ee43 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:10.903532 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d2017587-ecb4-4f29-93c1-68ec1949ee43 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:10.905032 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d2017587-ecb4-4f29-93c1-68ec1949ee43 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:10.906178 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d2017587-ecb4-4f29-93c1-68ec1949ee43 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1407 microversion: 2.20 time: 0.183680 Jun 30 16:39:10.906785 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 353/702] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:10 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:39:10.991994 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-78f2f3f6-9e9e-43b3-8416-3c9247658515 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments/37abf47d-f6e3-4ce8-a076-c00dacefb402" status: 202 len: 0 microversion: 2.1 time: 0.485595 Jun 30 16:39:10.991994 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 350/703] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 30 16:39:10 2022] DELETE /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments/37abf47d-f6e3-4ce8-a076-c00dacefb402 => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 16:39:11.002401 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8e3d4ada-3f03-42f1-a917-c4018a63349d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:11.003953 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8e3d4ada-3f03-42f1-a917-c4018a63349d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:11.012199 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8e3d4ada-3f03-42f1-a917-c4018a63349d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:11.012684 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8e3d4ada-3f03-42f1-a917-c4018a63349d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:11.020824 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8e3d4ada-3f03-42f1-a917-c4018a63349d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:11.020824 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8e3d4ada-3f03-42f1-a917-c4018a63349d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:11.048086 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8e3d4ada-3f03-42f1-a917-c4018a63349d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051005 Jun 30 16:39:11.048745 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 354/704] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:39:10 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:11.261961 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-23c4a61b-cb26-4fdc-9705-49f629b95b9f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:11.262575 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-23c4a61b-cb26-4fdc-9705-49f629b95b9f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:11.269713 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-23c4a61b-cb26-4fdc-9705-49f629b95b9f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:11.270170 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-23c4a61b-cb26-4fdc-9705-49f629b95b9f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:11.271887 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-23c4a61b-cb26-4fdc-9705-49f629b95b9f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:11.272524 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-23c4a61b-cb26-4fdc-9705-49f629b95b9f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:11.418498 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-23c4a61b-cb26-4fdc-9705-49f629b95b9f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:11.428732 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-23c4a61b-cb26-4fdc-9705-49f629b95b9f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1672 microversion: 2.1 time: 0.170077 Jun 30 16:39:11.429366 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 351/705] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:11 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:11.926203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6687bf73-f101-40dc-9f27-bab9faa954ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:11.926815 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6687bf73-f101-40dc-9f27-bab9faa954ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:11.934414 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6687bf73-f101-40dc-9f27-bab9faa954ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:11.934867 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6687bf73-f101-40dc-9f27-bab9faa954ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:11.935686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6687bf73-f101-40dc-9f27-bab9faa954ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:11.936118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6687bf73-f101-40dc-9f27-bab9faa954ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:12.061022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6d2d35db-34ba-44c2-95a9-665782cdee77 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:12.062008 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6d2d35db-34ba-44c2-95a9-665782cdee77 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:12.069061 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d2d35db-34ba-44c2-95a9-665782cdee77 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:12.069534 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d2d35db-34ba-44c2-95a9-665782cdee77 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:12.070291 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d2d35db-34ba-44c2-95a9-665782cdee77 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:12.070749 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6d2d35db-34ba-44c2-95a9-665782cdee77 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:12.075879 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6687bf73-f101-40dc-9f27-bab9faa954ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:12.084588 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6687bf73-f101-40dc-9f27-bab9faa954ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:12.086100 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6687bf73-f101-40dc-9f27-bab9faa954ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:12.087235 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6687bf73-f101-40dc-9f27-bab9faa954ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1407 microversion: 2.20 time: 0.165078 Jun 30 16:39:12.087843 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 355/706] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:11 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:39:12.100578 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6d2d35db-34ba-44c2-95a9-665782cdee77 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043661 Jun 30 16:39:12.101132 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 352/707] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:39:12 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:39:12.447990 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e81cb5ba-8708-4a81-a156-05cb06157955 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:12.448633 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e81cb5ba-8708-4a81-a156-05cb06157955 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:12.454652 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e81cb5ba-8708-4a81-a156-05cb06157955 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:12.455100 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e81cb5ba-8708-4a81-a156-05cb06157955 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:12.455960 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e81cb5ba-8708-4a81-a156-05cb06157955 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:12.456398 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e81cb5ba-8708-4a81-a156-05cb06157955 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:12.592803 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e81cb5ba-8708-4a81-a156-05cb06157955 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:12.601628 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e81cb5ba-8708-4a81-a156-05cb06157955 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1672 microversion: 2.1 time: 0.157409 Jun 30 16:39:12.602792 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 356/708] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:12 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:13.106096 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f65020a8-2ae1-4024-993b-29305fc03669 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:13.106758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f65020a8-2ae1-4024-993b-29305fc03669 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:13.114396 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-318bc015-1ab2-4f85-b28b-697c24c06410 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:13.115702 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-318bc015-1ab2-4f85-b28b-697c24c06410 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:13.116730 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f65020a8-2ae1-4024-993b-29305fc03669 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:13.117276 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f65020a8-2ae1-4024-993b-29305fc03669 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:13.118196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f65020a8-2ae1-4024-993b-29305fc03669 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:13.118745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f65020a8-2ae1-4024-993b-29305fc03669 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:13.121674 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-318bc015-1ab2-4f85-b28b-697c24c06410 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:13.122129 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-318bc015-1ab2-4f85-b28b-697c24c06410 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:13.122922 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-318bc015-1ab2-4f85-b28b-697c24c06410 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:13.123365 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-318bc015-1ab2-4f85-b28b-697c24c06410 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:13.169897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-318bc015-1ab2-4f85-b28b-697c24c06410 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059493 Jun 30 16:39:13.174233 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 357/709] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:39:13 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:13.339361 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f65020a8-2ae1-4024-993b-29305fc03669 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:13.353839 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f65020a8-2ae1-4024-993b-29305fc03669 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:13.353839 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f65020a8-2ae1-4024-993b-29305fc03669 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:13.354552 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f65020a8-2ae1-4024-993b-29305fc03669 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1407 microversion: 2.20 time: 0.252101 Jun 30 16:39:13.355243 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 353/710] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:13 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:39:13.618973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f5a126f0-c926-49ff-8e54-e5db068ccd54 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:13.619934 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f5a126f0-c926-49ff-8e54-e5db068ccd54 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:13.625642 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=2 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:13.626379 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=6 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:13.628495 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f5a126f0-c926-49ff-8e54-e5db068ccd54 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:13.628958 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f5a126f0-c926-49ff-8e54-e5db068ccd54 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:13.629748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f5a126f0-c926-49ff-8e54-e5db068ccd54 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:13.631180 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f5a126f0-c926-49ff-8e54-e5db068ccd54 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:13.786365 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=6 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:13.833189 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-23d42c04-1622-4614-86a1-1eea67aa9d90 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:13.833689 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-23d42c04-1622-4614-86a1-1eea67aa9d90 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:13.840596 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-23d42c04-1622-4614-86a1-1eea67aa9d90 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:13.841153 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-23d42c04-1622-4614-86a1-1eea67aa9d90 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:13.841944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-23d42c04-1622-4614-86a1-1eea67aa9d90 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:13.842381 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-23d42c04-1622-4614-86a1-1eea67aa9d90 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:13.868336 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-23d42c04-1622-4614-86a1-1eea67aa9d90 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/ips" status: 200 len: 149 microversion: 2.1 time: 0.295968 Jun 30 16:39:13.868917 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 358/711] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 30 16:39:13 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/ips => generated 149 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:14.007659 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f5a126f0-c926-49ff-8e54-e5db068ccd54 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:14.015485 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f5a126f0-c926-49ff-8e54-e5db068ccd54 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1672 microversion: 2.1 time: 0.400994 Jun 30 16:39:14.016416 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 354/712] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:13 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1672 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:14.183260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e9a35986-00c9-425d-a3f9-e1f9a5f66ed8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:14.184345 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e9a35986-00c9-425d-a3f9-e1f9a5f66ed8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:14.191039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e9a35986-00c9-425d-a3f9-e1f9a5f66ed8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:14.191524 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e9a35986-00c9-425d-a3f9-e1f9a5f66ed8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:14.192324 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e9a35986-00c9-425d-a3f9-e1f9a5f66ed8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:14.193004 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e9a35986-00c9-425d-a3f9-e1f9a5f66ed8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:14.221913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e9a35986-00c9-425d-a3f9-e1f9a5f66ed8 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043438 Jun 30 16:39:14.222472 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 359/713] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:39:14 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 16:39:14.306583 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f3d5c838-7e3d-4c8d-9d33-bc8eee2cc8d5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:14.307661 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f3d5c838-7e3d-4c8d-9d33-bc8eee2cc8d5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:14.315753 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f3d5c838-7e3d-4c8d-9d33-bc8eee2cc8d5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:14.316463 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f3d5c838-7e3d-4c8d-9d33-bc8eee2cc8d5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:14.317512 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f3d5c838-7e3d-4c8d-9d33-bc8eee2cc8d5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:14.317981 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f3d5c838-7e3d-4c8d-9d33-bc8eee2cc8d5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:14.347239 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f3d5c838-7e3d-4c8d-9d33-bc8eee2cc8d5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Going to try to terminate instance {{(pid=124814) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:39:14.372789 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-72c68bfb-7526-4d03-b63e-bd9362adec0b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:14.373439 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-72c68bfb-7526-4d03-b63e-bd9362adec0b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:14.379979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-72c68bfb-7526-4d03-b63e-bd9362adec0b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:14.380625 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-72c68bfb-7526-4d03-b63e-bd9362adec0b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:14.381689 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-72c68bfb-7526-4d03-b63e-bd9362adec0b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:14.382136 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-72c68bfb-7526-4d03-b63e-bd9362adec0b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:14.570524 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-72c68bfb-7526-4d03-b63e-bd9362adec0b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:14.579034 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-72c68bfb-7526-4d03-b63e-bd9362adec0b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:14.580613 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-72c68bfb-7526-4d03-b63e-bd9362adec0b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:14.581709 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-72c68bfb-7526-4d03-b63e-bd9362adec0b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1407 microversion: 2.20 time: 0.212947 Jun 30 16:39:14.593097 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 360/714] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:14 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:39:14.710623 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f3d5c838-7e3d-4c8d-9d33-bc8eee2cc8d5 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 204 len: 0 microversion: 2.1 time: 0.407228 Jun 30 16:39:14.711622 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 355/715] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:39:14 2022] DELETE /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:39:14.719596 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-3c44b448-e4e3-44ea-99a2-7a4ce89450e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:14.725046 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-3c44b448-e4e3-44ea-99a2-7a4ce89450e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:14.732145 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3c44b448-e4e3-44ea-99a2-7a4ce89450e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:14.732679 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3c44b448-e4e3-44ea-99a2-7a4ce89450e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:14.733618 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3c44b448-e4e3-44ea-99a2-7a4ce89450e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:14.735161 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3c44b448-e4e3-44ea-99a2-7a4ce89450e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:14.752917 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-91c46f64-5057-48f7-bf35-4892c4d15b3f req-3dec74b3-465f-4d87-89be-e35a96f46686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32f21182-53c1-471e-b55f-3f5654e72daf", "name": "network-vif-deleted", "tag": "159acf30-2cf3-40f6-aa1f-50b4d29f5f28"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:14.762316 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-91c46f64-5057-48f7-bf35-4892c4d15b3f req-3dec74b3-465f-4d87-89be-e35a96f46686 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:14.762840 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-91c46f64-5057-48f7-bf35-4892c4d15b3f req-3dec74b3-465f-4d87-89be-e35a96f46686 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:14.776990 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-91c46f64-5057-48f7-bf35-4892c4d15b3f req-3dec74b3-465f-4d87-89be-e35a96f46686 service nova] Creating event network-vif-deleted:159acf30-2cf3-40f6-aa1f-50b4d29f5f28 for instance 32f21182-53c1-471e-b55f-3f5654e72daf on hv-cinder-83602 Jun 30 16:39:14.782847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-91c46f64-5057-48f7-bf35-4892c4d15b3f req-3dec74b3-465f-4d87-89be-e35a96f46686 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034289 Jun 30 16:39:14.793439 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 356/716] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:39:14.887323 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-8b1cb602-4f9b-4985-a222-0bfabe80c49f req-78f7ca8f-b79c-4308-8489-b664e4ed0287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e41d57-839c-4b6e-8215-d67d1d428958", "name": "network-vif-plugged", "status": "completed", "tag": "cef899ca-3465-4288-82e5-31385d9c468b"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:14.903784 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-8b1cb602-4f9b-4985-a222-0bfabe80c49f req-78f7ca8f-b79c-4308-8489-b664e4ed0287 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:14.904772 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-8b1cb602-4f9b-4985-a222-0bfabe80c49f req-78f7ca8f-b79c-4308-8489-b664e4ed0287 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:14.922613 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-8b1cb602-4f9b-4985-a222-0bfabe80c49f req-78f7ca8f-b79c-4308-8489-b664e4ed0287 service nova] Creating event network-vif-plugged:cef899ca-3465-4288-82e5-31385d9c468b for instance 50e41d57-839c-4b6e-8215-d67d1d428958 on hv-cinder-83602 Jun 30 16:39:14.930497 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-8b1cb602-4f9b-4985-a222-0bfabe80c49f req-78f7ca8f-b79c-4308-8489-b664e4ed0287 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047282 Jun 30 16:39:14.931130 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-3c44b448-e4e3-44ea-99a2-7a4ce89450e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:14.931591 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 357/717] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:14.940020 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-3c44b448-e4e3-44ea-99a2-7a4ce89450e7 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1689 microversion: 2.1 time: 0.224317 Jun 30 16:39:14.940657 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 361/718] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:14 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1689 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:15.040231 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7b6ab352-2d9c-4f77-9265-e37293823210 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:15.040231 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7b6ab352-2d9c-4f77-9265-e37293823210 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:15.042925 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b6ab352-2d9c-4f77-9265-e37293823210 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:15.043606 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b6ab352-2d9c-4f77-9265-e37293823210 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:15.044447 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b6ab352-2d9c-4f77-9265-e37293823210 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:15.045127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b6ab352-2d9c-4f77-9265-e37293823210 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:15.117113 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7b6ab352-2d9c-4f77-9265-e37293823210 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:15.125133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7b6ab352-2d9c-4f77-9265-e37293823210 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1605 microversion: 2.1 time: 0.095109 Jun 30 16:39:15.125714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 358/719] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:15 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1605 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:15.605679 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-82662dec-eba7-4c2a-9414-1a23cf4d496c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:15.606226 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-82662dec-eba7-4c2a-9414-1a23cf4d496c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:15.613233 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-82662dec-eba7-4c2a-9414-1a23cf4d496c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:15.613687 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-82662dec-eba7-4c2a-9414-1a23cf4d496c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:15.614486 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-82662dec-eba7-4c2a-9414-1a23cf4d496c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:15.615521 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-82662dec-eba7-4c2a-9414-1a23cf4d496c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:15.678683 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c7e3cadd-c906-48cc-872b-53b7be6e8b7c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5336a57-8717-43f1-827f-29da99755d4b"}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:15.679796 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c7e3cadd-c906-48cc-872b-53b7be6e8b7c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:15.686748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c7e3cadd-c906-48cc-872b-53b7be6e8b7c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:15.687209 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c7e3cadd-c906-48cc-872b-53b7be6e8b7c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:15.687992 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c7e3cadd-c906-48cc-872b-53b7be6e8b7c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:15.688650 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c7e3cadd-c906-48cc-872b-53b7be6e8b7c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:15.761653 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-82662dec-eba7-4c2a-9414-1a23cf4d496c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:15.769865 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-82662dec-eba7-4c2a-9414-1a23cf4d496c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:15.772332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-82662dec-eba7-4c2a-9414-1a23cf4d496c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:15.773457 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-82662dec-eba7-4c2a-9414-1a23cf4d496c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1407 microversion: 2.20 time: 0.173138 Jun 30 16:39:15.783365 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 362/720] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:15 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:39:15.957592 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0f3050f5-ab4c-43a9-aeb9-6bb2030214c4 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:15.958906 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-0f3050f5-ab4c-43a9-aeb9-6bb2030214c4 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:15.966011 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0f3050f5-ab4c-43a9-aeb9-6bb2030214c4 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:15.966470 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0f3050f5-ab4c-43a9-aeb9-6bb2030214c4 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:15.972691 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0f3050f5-ab4c-43a9-aeb9-6bb2030214c4 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:15.972691 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0f3050f5-ab4c-43a9-aeb9-6bb2030214c4 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:15.972691 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=100 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:16.106302 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-0f3050f5-ab4c-43a9-aeb9-6bb2030214c4 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:16.114911 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-0f3050f5-ab4c-43a9-aeb9-6bb2030214c4 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1689 microversion: 2.1 time: 0.161063 Jun 30 16:39:16.115431 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 363/721] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:15 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:16.142657 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-91b01878-810f-48dd-94b0-41bef75db908 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:16.143289 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-91b01878-810f-48dd-94b0-41bef75db908 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:16.150163 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-91b01878-810f-48dd-94b0-41bef75db908 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:16.150727 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-91b01878-810f-48dd-94b0-41bef75db908 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:16.151418 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-91b01878-810f-48dd-94b0-41bef75db908 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:16.151809 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-91b01878-810f-48dd-94b0-41bef75db908 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:16.219188 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-91b01878-810f-48dd-94b0-41bef75db908 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:16.227322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-91b01878-810f-48dd-94b0-41bef75db908 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1605 microversion: 2.1 time: 0.088851 Jun 30 16:39:16.227953 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 364/722] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:16 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1605 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:16.792228 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2cb8809b-9777-43cf-bf07-723b7f00aff7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:16.792896 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2cb8809b-9777-43cf-bf07-723b7f00aff7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:16.800062 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2cb8809b-9777-43cf-bf07-723b7f00aff7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:16.800511 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2cb8809b-9777-43cf-bf07-723b7f00aff7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:16.801283 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2cb8809b-9777-43cf-bf07-723b7f00aff7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:16.801717 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2cb8809b-9777-43cf-bf07-723b7f00aff7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:16.950173 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2cb8809b-9777-43cf-bf07-723b7f00aff7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:16.959341 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2cb8809b-9777-43cf-bf07-723b7f00aff7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:16.960852 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2cb8809b-9777-43cf-bf07-723b7f00aff7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:16.961958 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2cb8809b-9777-43cf-bf07-723b7f00aff7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1407 microversion: 2.20 time: 0.174360 Jun 30 16:39:16.962525 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 365/723] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:16 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:39:17.132209 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b7827499-557f-48cd-a9e7-259f4d246030 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:17.132829 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b7827499-557f-48cd-a9e7-259f4d246030 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:17.138964 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b7827499-557f-48cd-a9e7-259f4d246030 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:17.139417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b7827499-557f-48cd-a9e7-259f4d246030 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:17.140233 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b7827499-557f-48cd-a9e7-259f4d246030 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:17.140678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b7827499-557f-48cd-a9e7-259f4d246030 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:17.275885 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b7827499-557f-48cd-a9e7-259f4d246030 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:17.283408 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b7827499-557f-48cd-a9e7-259f4d246030 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1689 microversion: 2.1 time: 0.155270 Jun 30 16:39:17.284005 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 366/724] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:17 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:17.289323 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9111bbaa-2aa5-40eb-8749-93a17b6e38d1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:17.289910 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9111bbaa-2aa5-40eb-8749-93a17b6e38d1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:17.295886 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9111bbaa-2aa5-40eb-8749-93a17b6e38d1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:17.296339 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9111bbaa-2aa5-40eb-8749-93a17b6e38d1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:17.297104 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9111bbaa-2aa5-40eb-8749-93a17b6e38d1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:17.297544 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9111bbaa-2aa5-40eb-8749-93a17b6e38d1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:17.362393 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9111bbaa-2aa5-40eb-8749-93a17b6e38d1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:17.370002 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9111bbaa-2aa5-40eb-8749-93a17b6e38d1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1605 microversion: 2.1 time: 0.085049 Jun 30 16:39:17.370566 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 367/725] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:17 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1605 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:17.980997 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-fe8c7792-d471-4a36-b130-7fe0971c7fd1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:17.981710 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-fe8c7792-d471-4a36-b130-7fe0971c7fd1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:17.988333 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe8c7792-d471-4a36-b130-7fe0971c7fd1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:17.988812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe8c7792-d471-4a36-b130-7fe0971c7fd1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:17.989583 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe8c7792-d471-4a36-b130-7fe0971c7fd1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:17.990686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fe8c7792-d471-4a36-b130-7fe0971c7fd1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:18.129676 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-fe8c7792-d471-4a36-b130-7fe0971c7fd1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:18.139970 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-fe8c7792-d471-4a36-b130-7fe0971c7fd1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:18.141569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-fe8c7792-d471-4a36-b130-7fe0971c7fd1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:18.142731 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-fe8c7792-d471-4a36-b130-7fe0971c7fd1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1407 microversion: 2.20 time: 0.165683 Jun 30 16:39:18.148522 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 368/726] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:17 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:39:18.301736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-14c79910-d4d4-4c3f-acef-8e97720f2850 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:18.302776 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-14c79910-d4d4-4c3f-acef-8e97720f2850 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:18.312288 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-14c79910-d4d4-4c3f-acef-8e97720f2850 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:18.312746 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-14c79910-d4d4-4c3f-acef-8e97720f2850 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:18.313537 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-14c79910-d4d4-4c3f-acef-8e97720f2850 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:18.314007 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-14c79910-d4d4-4c3f-acef-8e97720f2850 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:18.514994 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-14c79910-d4d4-4c3f-acef-8e97720f2850 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:18.522811 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-14c79910-d4d4-4c3f-acef-8e97720f2850 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1689 microversion: 2.1 time: 0.225110 Jun 30 16:39:18.531875 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 369/727] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:18 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1689 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:18.537389 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2ceec7fc-2aad-4779-b9ed-4f2e37eec1cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:18.538052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2ceec7fc-2aad-4779-b9ed-4f2e37eec1cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:18.544578 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2ceec7fc-2aad-4779-b9ed-4f2e37eec1cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:18.546470 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2ceec7fc-2aad-4779-b9ed-4f2e37eec1cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:18.546470 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2ceec7fc-2aad-4779-b9ed-4f2e37eec1cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:18.546470 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2ceec7fc-2aad-4779-b9ed-4f2e37eec1cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:18.590545 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2ceec7fc-2aad-4779-b9ed-4f2e37eec1cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:18.591001 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2ceec7fc-2aad-4779-b9ed-4f2e37eec1cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:18.591455 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-2ceec7fc-2aad-4779-b9ed-4f2e37eec1cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lazy-loading 'fault' on Instance uuid 32f21182-53c1-471e-b55f-3f5654e72daf {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:39:18.648288 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2ceec7fc-2aad-4779-b9ed-4f2e37eec1cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:18.656153 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2ceec7fc-2aad-4779-b9ed-4f2e37eec1cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1328 microversion: 2.1 time: 0.123197 Jun 30 16:39:18.656740 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 370/728] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:18 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1328 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:18.901521 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c7e3cadd-c906-48cc-872b-53b7be6e8b7c tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "POST /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.227451 Jun 30 16:39:18.902475 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 359/729] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 30 16:39:15 2022] POST /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-volume_attachments => generated 194 bytes in 3229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:39:19.162504 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f5008a88-cb56-43ab-bfc6-1345ef454923 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:19.163393 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f5008a88-cb56-43ab-bfc6-1345ef454923 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:19.169867 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f5008a88-cb56-43ab-bfc6-1345ef454923 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:19.170422 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f5008a88-cb56-43ab-bfc6-1345ef454923 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:19.171251 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f5008a88-cb56-43ab-bfc6-1345ef454923 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:19.171806 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f5008a88-cb56-43ab-bfc6-1345ef454923 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:19.390536 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f5008a88-cb56-43ab-bfc6-1345ef454923 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:19.399021 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f5008a88-cb56-43ab-bfc6-1345ef454923 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:19.400546 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f5008a88-cb56-43ab-bfc6-1345ef454923 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:19.401653 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f5008a88-cb56-43ab-bfc6-1345ef454923 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1407 microversion: 2.20 time: 0.244340 Jun 30 16:39:19.402212 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 371/730] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:19 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:39:19.540961 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-704e7229-4a1a-43ad-ad0c-d34453561703 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:19.541787 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-704e7229-4a1a-43ad-ad0c-d34453561703 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:19.550128 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-704e7229-4a1a-43ad-ad0c-d34453561703 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:19.550931 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-704e7229-4a1a-43ad-ad0c-d34453561703 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:19.552034 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-704e7229-4a1a-43ad-ad0c-d34453561703 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:19.552863 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-704e7229-4a1a-43ad-ad0c-d34453561703 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:19.565597 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-81567ee0-4bc4-4083-9f28-306c5946eea7 req-c9c149a2-f07e-4dc5-8e42-05c73e25435c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d786bea4-1a92-4eaf-8450-f69f05986687", "name": "network-vif-deleted", "tag": "237f85c7-d517-4bd7-9b4c-cfb1b755a321"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:19.587506 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-81567ee0-4bc4-4083-9f28-306c5946eea7 req-c9c149a2-f07e-4dc5-8e42-05c73e25435c service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:19.592445 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-81567ee0-4bc4-4083-9f28-306c5946eea7 req-c9c149a2-f07e-4dc5-8e42-05c73e25435c service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:19.611223 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-81567ee0-4bc4-4083-9f28-306c5946eea7 req-c9c149a2-f07e-4dc5-8e42-05c73e25435c service nova] Creating event network-vif-deleted:237f85c7-d517-4bd7-9b4c-cfb1b755a321 for instance d786bea4-1a92-4eaf-8450-f69f05986687 on hv-cinder-83602 Jun 30 16:39:19.619263 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-81567ee0-4bc4-4083-9f28-306c5946eea7 req-c9c149a2-f07e-4dc5-8e42-05c73e25435c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153705 Jun 30 16:39:19.631685 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 360/731] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:19.675153 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-704e7229-4a1a-43ad-ad0c-d34453561703 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:19.675571 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-84683b51-b4ed-4ca0-9cfd-a31f26733c66 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:19.676604 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-84683b51-b4ed-4ca0-9cfd-a31f26733c66 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:19.684334 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-704e7229-4a1a-43ad-ad0c-d34453561703 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1621 microversion: 2.1 time: 0.148421 Jun 30 16:39:19.698374 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-84683b51-b4ed-4ca0-9cfd-a31f26733c66 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:19.698374 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-84683b51-b4ed-4ca0-9cfd-a31f26733c66 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:19.698374 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-84683b51-b4ed-4ca0-9cfd-a31f26733c66 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:19.698374 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-84683b51-b4ed-4ca0-9cfd-a31f26733c66 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:19.698750 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 372/732] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:19 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1621 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:19.712026 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:19.730104 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-84683b51-b4ed-4ca0-9cfd-a31f26733c66 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:19.730728 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-84683b51-b4ed-4ca0-9cfd-a31f26733c66 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:19.731180 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-84683b51-b4ed-4ca0-9cfd-a31f26733c66 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lazy-loading 'fault' on Instance uuid 32f21182-53c1-471e-b55f-3f5654e72daf {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:39:19.777938 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-84683b51-b4ed-4ca0-9cfd-a31f26733c66 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:19.790489 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-84683b51-b4ed-4ca0-9cfd-a31f26733c66 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 200 len: 1328 microversion: 2.1 time: 0.121432 Jun 30 16:39:19.791080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 361/733] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:19 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 1328 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:20.420702 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-53268079-4111-4a1e-b7b4-bfc52ef10d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:20.421364 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-53268079-4111-4a1e-b7b4-bfc52ef10d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:20.429239 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-53268079-4111-4a1e-b7b4-bfc52ef10d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:20.429701 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-53268079-4111-4a1e-b7b4-bfc52ef10d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:20.430481 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-53268079-4111-4a1e-b7b4-bfc52ef10d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:20.430918 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-53268079-4111-4a1e-b7b4-bfc52ef10d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:20.572594 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-53268079-4111-4a1e-b7b4-bfc52ef10d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:20.580993 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-53268079-4111-4a1e-b7b4-bfc52ef10d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:20.582576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-53268079-4111-4a1e-b7b4-bfc52ef10d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:20.584318 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-53268079-4111-4a1e-b7b4-bfc52ef10d88 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1598 microversion: 2.20 time: 0.167051 Jun 30 16:39:20.584895 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 373/734] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:39:20 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1598 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:39:20.603680 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3cef5660-3ecf-4786-8b3b-144a13a86203 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:20.604256 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3cef5660-3ecf-4786-8b3b-144a13a86203 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:20.611092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3cef5660-3ecf-4786-8b3b-144a13a86203 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:20.611571 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3cef5660-3ecf-4786-8b3b-144a13a86203 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:20.612335 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3cef5660-3ecf-4786-8b3b-144a13a86203 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:20.614066 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3cef5660-3ecf-4786-8b3b-144a13a86203 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:20.702381 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-070f9923-d8f9-4396-bdd8-ed1c94c9941d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:20.703093 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-070f9923-d8f9-4396-bdd8-ed1c94c9941d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:20.703730 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3cef5660-3ecf-4786-8b3b-144a13a86203 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105600 Jun 30 16:39:20.704349 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 362/735] 10.222.0.67 () {60 vars in 1315 bytes} [Thu Jun 30 16:39:20 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:39:20.710013 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-070f9923-d8f9-4396-bdd8-ed1c94c9941d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:20.710845 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-070f9923-d8f9-4396-bdd8-ed1c94c9941d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:20.711435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-070f9923-d8f9-4396-bdd8-ed1c94c9941d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:20.711909 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-070f9923-d8f9-4396-bdd8-ed1c94c9941d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:20.747634 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-070f9923-d8f9-4396-bdd8-ed1c94c9941d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:20.747935 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-070f9923-d8f9-4396-bdd8-ed1c94c9941d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:20.748402 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-070f9923-d8f9-4396-bdd8-ed1c94c9941d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lazy-loading 'fault' on Instance uuid d786bea4-1a92-4eaf-8450-f69f05986687 {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:39:20.795461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-070f9923-d8f9-4396-bdd8-ed1c94c9941d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:20.807363 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-070f9923-d8f9-4396-bdd8-ed1c94c9941d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 200 len: 1335 microversion: 2.1 time: 0.109289 Jun 30 16:39:20.807999 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 374/736] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:20 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 1335 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:20.811645 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3f5d79c4-2e46-4124-87e4-150c43a32e2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:20.811645 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3f5d79c4-2e46-4124-87e4-150c43a32e2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:20.817534 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3f5d79c4-2e46-4124-87e4-150c43a32e2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:20.818224 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3f5d79c4-2e46-4124-87e4-150c43a32e2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:20.819206 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3f5d79c4-2e46-4124-87e4-150c43a32e2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:20.820002 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3f5d79c4-2e46-4124-87e4-150c43a32e2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:20.843860 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-3f5d79c4-2e46-4124-87e4-150c43a32e2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] HTTP exception thrown: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3f5d79c4-2e46-4124-87e4-150c43a32e2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Request method failure captured: Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf HTTP/1.1 Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdB4iD_JYyc3ecRZANBT8_ULN1BCIN6_XcwY-5HBg0w3c5VSpX-068BW-6WK7UMnIj_iCIfvKPm3kkVoY79lBXCRd3O556Sk_fL8UdIZEu_o6dfpZHT5pvIk_oy9S_DoEP52GzVOETOJtECSbVS0mzsXgJVbAeMwDApAwppOw1AzpQU Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 80a9bf240ed0447faaf33bec8f19cb70 Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:39:20.845520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:39:20.847058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/80a9bf240ed0447faaf33bec8f19cb70"}]}] Jun 30 16:39:20.847058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:39:20.847058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 80a9bf240ed0447faaf33bec8f19cb70 Jun 30 16:39:20.847058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:39:20.847058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-AttachVolumeTestJSON-978962822-project Jun 30 16:39:20.847058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:39:20.847058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:39:20.847058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 18f2856b1d3742a1aca89b4aeec0a3bd Jun 30 16:39:20.847058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-AttachVolumeTestJSON-978962822-project Jun 30 16:39:20.847058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:39:20.847058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:39:20.847058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': '32f21182-53c1-471e-b55f-3f5654e72daf'} Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:39:20.848490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:39:20.851871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:20.854357 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3f5d79c4-2e46-4124-87e4-150c43a32e2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Returning 404 to user: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:39:20.854357 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3f5d79c4-2e46-4124-87e4-150c43a32e2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 404 len: 111 microversion: 2.1 time: 0.042977 Jun 30 16:39:20.854357 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 363/737] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:20 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:39:20.856912 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-05f9319c-e693-4377-abba-8f76a02b4c6e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '.version_select at 0x7f38202b15e0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:20.966321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-05f9319c-e693-4377-abba-8f76a02b4c6e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2119489249" status: 202 len: 0 microversion: 2.1 time: 0.113054 Jun 30 16:39:20.967453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 375/738] 10.222.0.67 () {58 vars in 1220 bytes} [Thu Jun 30 16:39:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2119489249 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:39:21.828324 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-19f82025-83ef-4bd0-abbe-7ec551695ac9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:21.828937 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-19f82025-83ef-4bd0-abbe-7ec551695ac9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: d786bea4-1a92-4eaf-8450-f69f05986687] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:21.837636 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-19f82025-83ef-4bd0-abbe-7ec551695ac9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:21.842359 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-19f82025-83ef-4bd0-abbe-7ec551695ac9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:21.842359 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-19f82025-83ef-4bd0-abbe-7ec551695ac9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:21.842359 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-19f82025-83ef-4bd0-abbe-7ec551695ac9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:21.848835 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-163eb2b9-0185-478b-ae3a-fcc1efeb4693 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Action: 'create', calling method: .version_select at 0x7f382019ae50>, body: {"keypair": {"name": "tempest-keypair-1224866204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTNQXbj1qGJw1Pjn5iMhoFZ9Jx5UV0NWV/kYp7bpV0mjeAKcODXMbavdv/mEAL7yFBrE6b32WCSQLQwtQvxH6AdJuJn3INeZaBehwysSyohSkFqiBNqrZrtGEz3fnTH8Q=="}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:21.853837 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-19f82025-83ef-4bd0-abbe-7ec551695ac9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] HTTP exception thrown: Instance d786bea4-1a92-4eaf-8450-f69f05986687 could not be found. Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-19f82025-83ef-4bd0-abbe-7ec551695ac9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Request method failure captured: Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 HTTP/1.1 Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdBwM9qvHtOnFqUQDtbBU25dM8LsDJJTw1pxd--fjd3blMXEcKPhQWZ-a27FdgjxBMK6dTUcUQH6ay8X0VGGzhyFlL71iFHTgsLgL0YYMg5CBUCtAhR-PSa6BNDD22qbdj4XsHc-GH7-1ZaAlg1BvKwRS17UakMMM4b-BX-kEr6NtA0 Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 839a189179c543c6a704a968170ec022 Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:39:21.855544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:39:21.861748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/839a189179c543c6a704a968170ec022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/839a189179c543c6a704a968170ec022"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_839a189179c543c6a704a968170ec022"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/839a189179c543c6a704a968170ec022"}]}] Jun 30 16:39:21.861748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:39:21.861748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 839a189179c543c6a704a968170ec022 Jun 30 16:39:21.861748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:39:21.861748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-ServerRescueNegativeTestJSON-1419143453-project Jun 30 16:39:21.861748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:39:21.861748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:39:21.861748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 2de23770f4374decb95ff94f3e7f793b Jun 30 16:39:21.861748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1419143453-project Jun 30 16:39:21.861748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:39:21.861748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance d786bea4-1a92-4eaf-8450-f69f05986687 could not be found. Jun 30 16:39:21.861748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': 'd786bea4-1a92-4eaf-8450-f69f05986687'} Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d786bea4-1a92-4eaf-8450-f69f05986687 could not be found. Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:39:21.862488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d786bea4-1a92-4eaf-8450-f69f05986687 could not be found. Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d786bea4-1a92-4eaf-8450-f69f05986687 could not be found. Jun 30 16:39:21.863773 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:21.865396 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-19f82025-83ef-4bd0-abbe-7ec551695ac9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Returning 404 to user: Instance d786bea4-1a92-4eaf-8450-f69f05986687 could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:39:21.865396 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-19f82025-83ef-4bd0-abbe-7ec551695ac9 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687" status: 404 len: 111 microversion: 2.1 time: 0.033177 Jun 30 16:39:21.865396 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 364/739] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:21 2022] GET /compute/v2.1/servers/d786bea4-1a92-4eaf-8450-f69f05986687 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:39:21.868648 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-35fe24f6-26f0-4dbe-b3ad-462b36ff2558 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '.version_select at 0x7f382021dca0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:21.870017 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-163eb2b9-0185-478b-ae3a-fcc1efeb4693 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Getting quotas for project 80a9bf240ed0447faaf33bec8f19cb70. Resources: {'key_pairs'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:39:21.874161 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-163eb2b9-0185-478b-ae3a-fcc1efeb4693 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Getting quotas for user 18f2856b1d3742a1aca89b4aeec0a3bd and project 80a9bf240ed0447faaf33bec8f19cb70. Resources: {'key_pairs'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:39:21.978827 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-35fe24f6-26f0-4dbe-b3ad-462b36ff2558 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1349269840" status: 202 len: 0 microversion: 2.1 time: 0.114731 Jun 30 16:39:21.982863 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 365/740] 10.222.0.67 () {58 vars in 1220 bytes} [Thu Jun 30 16:39:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1349269840 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 16:39:22.013030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-163eb2b9-0185-478b-ae3a-fcc1efeb4693 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.168496 Jun 30 16:39:22.013274 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 376/741] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 30 16:39:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:22.088837 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-07fd1a13-7684-4b87-a2c6-c49bb2ff5feb req-1099582f-ea1a-4512-92fa-e38c206a76aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50e41d57-839c-4b6e-8215-d67d1d428958", "tag": "cef899ca-3465-4288-82e5-31385d9c468b"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:22.098752 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-07fd1a13-7684-4b87-a2c6-c49bb2ff5feb req-1099582f-ea1a-4512-92fa-e38c206a76aa service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:22.099763 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-07fd1a13-7684-4b87-a2c6-c49bb2ff5feb req-1099582f-ea1a-4512-92fa-e38c206a76aa service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:22.111757 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-07fd1a13-7684-4b87-a2c6-c49bb2ff5feb req-1099582f-ea1a-4512-92fa-e38c206a76aa service nova] Creating event network-changed:cef899ca-3465-4288-82e5-31385d9c468b for instance 50e41d57-839c-4b6e-8215-d67d1d428958 on hv-cinder-83602 Jun 30 16:39:22.117488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-07fd1a13-7684-4b87-a2c6-c49bb2ff5feb req-1099582f-ea1a-4512-92fa-e38c206a76aa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090533 Jun 30 16:39:22.118662 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 366/742] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:25.113131 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1888421564", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8aed81da-8ea7-4176-b3f4-7d728693f230"}], "security_groups": [{"name": "tempest-securitygroup--358889661"}], "key_name": "tempest-keypair-1224866204", "user_data": "}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:25.217865 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.network.neutron [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] validate_networks() for [('8aed81da-8ea7-4176-b3f4-7d728693f230', None, None, None, None, None)] {{(pid=124815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:39:25.704865 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Flavor limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:39:25.705295 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Image limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:39:25.705772 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Flavor pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:39:25.706391 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Image pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:39:25.706813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:39:25.716775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:25.719143 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:25.719143 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:25.719143 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:25.735817 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Getting quotas for project 80a9bf240ed0447faaf33bec8f19cb70. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:39:25.740222 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Getting quotas for user 18f2856b1d3742a1aca89b4aeec0a3bd and project 80a9bf240ed0447faaf33bec8f19cb70. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:39:25.751692 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Going to run 1 instances... {{(pid=124815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:39:25.753984 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:39:25.928630 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-34ad61ef-889b-409f-bb4c-bf2e0d870b6b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.820392 Jun 30 16:39:25.928937 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-be4300af-f001-41cf-9663-2ad7ed8f0557 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:25.929456 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 377/743] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:39:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 16:39:25.930058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-be4300af-f001-41cf-9663-2ad7ed8f0557 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:25.937900 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-be4300af-f001-41cf-9663-2ad7ed8f0557 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:25.938347 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-be4300af-f001-41cf-9663-2ad7ed8f0557 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:25.939120 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-be4300af-f001-41cf-9663-2ad7ed8f0557 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:25.939596 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-be4300af-f001-41cf-9663-2ad7ed8f0557 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:25.940344 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-03af5f0f-3949-45cd-9c41-4565f7e8a21e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:25.941064 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-03af5f0f-3949-45cd-9c41-4565f7e8a21e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:25.970577 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-be4300af-f001-41cf-9663-2ad7ed8f0557 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Going to try to terminate instance {{(pid=124814) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:39:26.003869 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-03af5f0f-3949-45cd-9c41-4565f7e8a21e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:26.013735 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-03af5f0f-3949-45cd-9c41-4565f7e8a21e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1238 microversion: 2.1 time: 0.076476 Jun 30 16:39:26.014335 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 378/744] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:25 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1238 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:26.252618 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-be4300af-f001-41cf-9663-2ad7ed8f0557 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "DELETE /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 204 len: 0 microversion: 2.1 time: 0.329211 Jun 30 16:39:26.253218 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 367/745] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:39:25 2022] DELETE /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 16:39:26.262070 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a4823e51-2e43-4534-b7b7-00a167cdea4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:26.262705 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a4823e51-2e43-4534-b7b7-00a167cdea4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:26.269638 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a4823e51-2e43-4534-b7b7-00a167cdea4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:26.270115 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a4823e51-2e43-4534-b7b7-00a167cdea4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:26.270918 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a4823e51-2e43-4534-b7b7-00a167cdea4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:26.272064 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a4823e51-2e43-4534-b7b7-00a167cdea4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:26.415915 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a4823e51-2e43-4534-b7b7-00a167cdea4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:26.423217 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a4823e51-2e43-4534-b7b7-00a167cdea4b tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1505 microversion: 2.1 time: 0.165204 Jun 30 16:39:26.423849 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 379/746] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:26 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:27.033652 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8feea549-c2f0-4b94-82c3-d3259daea4f9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:27.034357 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8feea549-c2f0-4b94-82c3-d3259daea4f9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:27.041671 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8feea549-c2f0-4b94-82c3-d3259daea4f9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:27.042124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8feea549-c2f0-4b94-82c3-d3259daea4f9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:27.042896 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8feea549-c2f0-4b94-82c3-d3259daea4f9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:27.043336 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8feea549-c2f0-4b94-82c3-d3259daea4f9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:27.109194 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8feea549-c2f0-4b94-82c3-d3259daea4f9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:27.116681 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8feea549-c2f0-4b94-82c3-d3259daea4f9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1242 microversion: 2.1 time: 0.087359 Jun 30 16:39:27.117251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 368/747] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:27 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:27.441815 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-cc530068-4644-421d-99ec-fb970cce9108 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:27.442566 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-cc530068-4644-421d-99ec-fb970cce9108 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:27.449742 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cc530068-4644-421d-99ec-fb970cce9108 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:27.450200 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cc530068-4644-421d-99ec-fb970cce9108 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:27.450978 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cc530068-4644-421d-99ec-fb970cce9108 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:27.451430 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cc530068-4644-421d-99ec-fb970cce9108 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:27.585478 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-cc530068-4644-421d-99ec-fb970cce9108 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:27.593125 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-cc530068-4644-421d-99ec-fb970cce9108 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1505 microversion: 2.1 time: 0.155139 Jun 30 16:39:27.593696 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 380/748] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:27 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:28.134265 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-eafd646d-4d50-49bb-8b08-3a96013b0da1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:28.134937 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-eafd646d-4d50-49bb-8b08-3a96013b0da1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:28.141685 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eafd646d-4d50-49bb-8b08-3a96013b0da1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:28.142141 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eafd646d-4d50-49bb-8b08-3a96013b0da1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:28.142921 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eafd646d-4d50-49bb-8b08-3a96013b0da1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:28.143360 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-eafd646d-4d50-49bb-8b08-3a96013b0da1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:28.210921 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-eafd646d-4d50-49bb-8b08-3a96013b0da1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:28.219249 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-eafd646d-4d50-49bb-8b08-3a96013b0da1 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1242 microversion: 2.1 time: 0.089539 Jun 30 16:39:28.219850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 369/749] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:28 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:28.586485 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0e632d93-254b-46d4-aa9a-300811cc3dbe tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5336a57-8717-43f1-827f-29da99755d4b"}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:28.588075 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-0e632d93-254b-46d4-aa9a-300811cc3dbe tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:28.594204 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0e632d93-254b-46d4-aa9a-300811cc3dbe tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:28.594647 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0e632d93-254b-46d4-aa9a-300811cc3dbe tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:28.595407 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0e632d93-254b-46d4-aa9a-300811cc3dbe tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:28.595867 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0e632d93-254b-46d4-aa9a-300811cc3dbe tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:28.610407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0ec16c87-2833-4044-a511-af1bed3cb72e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:28.611132 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0ec16c87-2833-4044-a511-af1bed3cb72e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:28.617924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0ec16c87-2833-4044-a511-af1bed3cb72e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:28.618443 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0ec16c87-2833-4044-a511-af1bed3cb72e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:28.619222 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0ec16c87-2833-4044-a511-af1bed3cb72e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:28.619867 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0ec16c87-2833-4044-a511-af1bed3cb72e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:28.692950 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-0e632d93-254b-46d4-aa9a-300811cc3dbe tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] HTTP exception thrown: Invalid volume: volume c5336a57-8717-43f1-827f-29da99755d4b is already attached to instances: 4eddee8f-330d-43f7-8877-50a589622e55 Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0e632d93-254b-46d4-aa9a-300811cc3dbe tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Request method failure captured: Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: POST /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-volume_attachments HTTP/1.1 Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 74 Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdByCRmKHFn3MWHXG9FHLumdqoFbcitofz3WTo4vIsqDgEdQTbCYdYkG6VrKJfwKSwNBul_mR6Pq6q8wsCNMbsOQVU-vBawcL74Th9xNCcWYhdHHThpX8bYg_ks1_lfyxu2cd7ltcDmgXQzda0-vc83XxV9QJd6mMtTnGfzh1bTh8BQ Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:39:28.695127 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:39:28.696812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f942ab31bafc428bb1fba94aee2e0c32"}]}] Jun 30 16:39:28.696812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:39:28.696812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:39:28.696812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:39:28.696812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:39:28.696812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:39:28.696812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:39:28.696812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 0a26028451b345968fe86774f44736dd Jun 30 16:39:28.696812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:39:28.696812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Jun 30 16:39:28.696812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {"volumeAttachment": {"volumeId": "c5336a57-8717-43f1-827f-29da99755d4b"}} Jun 30 16:39:28.696812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Invalid volume: volume c5336a57-8717-43f1-827f-29da99755d4b is already attached to instances: 4eddee8f-330d-43f7-8877-50a589622e55 Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'server_id': '4eddee8f-330d-43f7-8877-50a589622e55', 'body': {'volumeAttachment': {'volumeId': 'c5336a57-8717-43f1-827f-29da99755d4b'}}} Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c5336a57-8717-43f1-827f-29da99755d4b is already attached to instances: 4eddee8f-330d-43f7-8877-50a589622e55 Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:39:28.697704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c5336a57-8717-43f1-827f-29da99755d4b is already attached to instances: 4eddee8f-330d-43f7-8877-50a589622e55 Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:28.699026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:39:28.701219 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:39:28.701219 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:39:28.701219 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:39:28.701219 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c5336a57-8717-43f1-827f-29da99755d4b is already attached to instances: 4eddee8f-330d-43f7-8877-50a589622e55 Jun 30 16:39:28.701219 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:39:28.701219 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0e632d93-254b-46d4-aa9a-300811cc3dbe tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Returning 400 to user: Invalid volume: volume c5336a57-8717-43f1-827f-29da99755d4b is already attached to instances: 4eddee8f-330d-43f7-8877-50a589622e55 {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:39:28.701219 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-0e632d93-254b-46d4-aa9a-300811cc3dbe tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "POST /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115308 Jun 30 16:39:28.702797 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 381/750] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 30 16:39:28 2022] POST /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-volume_attachments => generated 174 bytes in 120 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 16:39:28.758377 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-12b66414-1b3b-47a8-9465-54322022298d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:28.758802 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-12b66414-1b3b-47a8-9465-54322022298d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:28.761696 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:28.765603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-12b66414-1b3b-47a8-9465-54322022298d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:28.766262 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-12b66414-1b3b-47a8-9465-54322022298d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:28.770169 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-12b66414-1b3b-47a8-9465-54322022298d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:28.770169 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-12b66414-1b3b-47a8-9465-54322022298d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:28.851376 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=100 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:28.856850 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-12b66414-1b3b-47a8-9465-54322022298d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lazy-loading 'services' on Instance uuid 4eddee8f-330d-43f7-8877-50a589622e55 {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:39:28.863434 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0ec16c87-2833-4044-a511-af1bed3cb72e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:28.874366 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0ec16c87-2833-4044-a511-af1bed3cb72e tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1505 microversion: 2.1 time: 0.267853 Jun 30 16:39:28.885784 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 370/751] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:28 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:29.131858 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-12b66414-1b3b-47a8-9465-54322022298d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-volume_attachments/c5336a57-8717-43f1-827f-29da99755d4b" status: 202 len: 0 microversion: 2.1 time: 0.376706 Jun 30 16:39:29.133291 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 382/752] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 30 16:39:28 2022] DELETE /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-volume_attachments/c5336a57-8717-43f1-827f-29da99755d4b => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 16:39:29.141470 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-dd705e81-ba4f-480d-b7cc-ffb09c47dc90 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:29.142479 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-dd705e81-ba4f-480d-b7cc-ffb09c47dc90 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:29.150566 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dd705e81-ba4f-480d-b7cc-ffb09c47dc90 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:29.152270 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dd705e81-ba4f-480d-b7cc-ffb09c47dc90 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:29.152270 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dd705e81-ba4f-480d-b7cc-ffb09c47dc90 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:29.153586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dd705e81-ba4f-480d-b7cc-ffb09c47dc90 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:29.191784 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-dd705e81-ba4f-480d-b7cc-ffb09c47dc90 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052728 Jun 30 16:39:29.193016 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 371/753] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:39:29 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:29.216581 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-f9b0a4df-8301-4820-9c0f-c6d46528881c req-c23c21e7-2a2b-46d5-9c22-8597e788672b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cc16fc2-454c-4941-8709-fc424d36d88c", "name": "network-vif-deleted", "tag": "b34f2ec4-8c64-4f05-98bb-ea3f485cf825"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:29.226228 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-f9b0a4df-8301-4820-9c0f-c6d46528881c req-c23c21e7-2a2b-46d5-9c22-8597e788672b service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:29.226776 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-f9b0a4df-8301-4820-9c0f-c6d46528881c req-c23c21e7-2a2b-46d5-9c22-8597e788672b service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:29.237558 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0c167daa-7704-4b19-80d6-34bb9101eeed tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:29.238290 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0c167daa-7704-4b19-80d6-34bb9101eeed tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:29.243298 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-f9b0a4df-8301-4820-9c0f-c6d46528881c req-c23c21e7-2a2b-46d5-9c22-8597e788672b service nova] Creating event network-vif-deleted:b34f2ec4-8c64-4f05-98bb-ea3f485cf825 for instance 1cc16fc2-454c-4941-8709-fc424d36d88c on hv-cinder-83602 Jun 30 16:39:29.245549 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0c167daa-7704-4b19-80d6-34bb9101eeed tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:29.246011 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0c167daa-7704-4b19-80d6-34bb9101eeed tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:29.246789 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0c167daa-7704-4b19-80d6-34bb9101eeed tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:29.247407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0c167daa-7704-4b19-80d6-34bb9101eeed tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:29.248750 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-f9b0a4df-8301-4820-9c0f-c6d46528881c req-c23c21e7-2a2b-46d5-9c22-8597e788672b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039932 Jun 30 16:39:29.249901 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 383/754] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:39:29.315879 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0c167daa-7704-4b19-80d6-34bb9101eeed tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:29.326669 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0c167daa-7704-4b19-80d6-34bb9101eeed tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1290 microversion: 2.1 time: 0.091308 Jun 30 16:39:29.326669 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 372/755] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:29 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:29.893930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-17b820e5-7694-46b2-a0ec-5c5e09341fd2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:29.894698 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-17b820e5-7694-46b2-a0ec-5c5e09341fd2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:29.903819 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-17b820e5-7694-46b2-a0ec-5c5e09341fd2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:29.904389 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-17b820e5-7694-46b2-a0ec-5c5e09341fd2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:29.905214 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-17b820e5-7694-46b2-a0ec-5c5e09341fd2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:29.905724 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-17b820e5-7694-46b2-a0ec-5c5e09341fd2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:29.940984 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-17b820e5-7694-46b2-a0ec-5c5e09341fd2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:29.941504 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-17b820e5-7694-46b2-a0ec-5c5e09341fd2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:29.942009 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-17b820e5-7694-46b2-a0ec-5c5e09341fd2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lazy-loading 'fault' on Instance uuid 1cc16fc2-454c-4941-8709-fc424d36d88c {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:39:29.996047 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-17b820e5-7694-46b2-a0ec-5c5e09341fd2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:30.004497 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-17b820e5-7694-46b2-a0ec-5c5e09341fd2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 200 len: 1311 microversion: 2.1 time: 0.115208 Jun 30 16:39:30.005079 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 384/756] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:29 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 1311 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:30.204205 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0fc581b0-e3f6-44ec-b55e-0b7d321291dc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:30.205162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0fc581b0-e3f6-44ec-b55e-0b7d321291dc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:30.212025 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0fc581b0-e3f6-44ec-b55e-0b7d321291dc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:30.212485 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0fc581b0-e3f6-44ec-b55e-0b7d321291dc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:30.213272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0fc581b0-e3f6-44ec-b55e-0b7d321291dc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:30.213714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0fc581b0-e3f6-44ec-b55e-0b7d321291dc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:30.260322 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0fc581b0-e3f6-44ec-b55e-0b7d321291dc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051989 Jun 30 16:39:30.262750 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 373/757] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:39:30 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:39:30.342810 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d5e4df2e-3b93-435d-bb99-61c11c6fd053 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:30.343865 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d5e4df2e-3b93-435d-bb99-61c11c6fd053 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:30.350311 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d5e4df2e-3b93-435d-bb99-61c11c6fd053 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:30.350813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d5e4df2e-3b93-435d-bb99-61c11c6fd053 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:30.351622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d5e4df2e-3b93-435d-bb99-61c11c6fd053 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:30.352066 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d5e4df2e-3b93-435d-bb99-61c11c6fd053 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:30.421871 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d5e4df2e-3b93-435d-bb99-61c11c6fd053 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:30.430834 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d5e4df2e-3b93-435d-bb99-61c11c6fd053 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1296 microversion: 2.1 time: 0.091865 Jun 30 16:39:30.431639 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 385/758] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:30 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:31.023208 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8969d763-66de-4c9a-9178-764a32432931 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:31.023869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8969d763-66de-4c9a-9178-764a32432931 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 1cc16fc2-454c-4941-8709-fc424d36d88c] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:31.031027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8969d763-66de-4c9a-9178-764a32432931 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.031493 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8969d763-66de-4c9a-9178-764a32432931 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.032332 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8969d763-66de-4c9a-9178-764a32432931 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.032760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8969d763-66de-4c9a-9178-764a32432931 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.047196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-8969d763-66de-4c9a-9178-764a32432931 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] HTTP exception thrown: Instance 1cc16fc2-454c-4941-8709-fc424d36d88c could not be found. Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8969d763-66de-4c9a-9178-764a32432931 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Request method failure captured: Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c HTTP/1.1 Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdBwM9qvHtOnFqUQDtbBU25dM8LsDJJTw1pxd--fjd3blMXEcKPhQWZ-a27FdgjxBMK6dTUcUQH6ay8X0VGGzhyFlL71iFHTgsLgL0YYMg5CBUCtAhR-PSa6BNDD22qbdj4XsHc-GH7-1ZaAlg1BvKwRS17UakMMM4b-BX-kEr6NtA0 Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 839a189179c543c6a704a968170ec022 Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:39:31.048966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:39:31.050615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/839a189179c543c6a704a968170ec022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/839a189179c543c6a704a968170ec022"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_839a189179c543c6a704a968170ec022"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/839a189179c543c6a704a968170ec022"}]}] Jun 30 16:39:31.050615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:39:31.050615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 839a189179c543c6a704a968170ec022 Jun 30 16:39:31.050615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:39:31.050615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-ServerRescueNegativeTestJSON-1419143453-project Jun 30 16:39:31.050615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:39:31.050615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:39:31.050615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 2de23770f4374decb95ff94f3e7f793b Jun 30 16:39:31.050615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1419143453-project Jun 30 16:39:31.050615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:39:31.050615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance 1cc16fc2-454c-4941-8709-fc424d36d88c could not be found. Jun 30 16:39:31.050615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': '1cc16fc2-454c-4941-8709-fc424d36d88c'} Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cc16fc2-454c-4941-8709-fc424d36d88c could not be found. Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:39:31.051464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cc16fc2-454c-4941-8709-fc424d36d88c could not be found. Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cc16fc2-454c-4941-8709-fc424d36d88c could not be found. Jun 30 16:39:31.053624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:31.055462 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8969d763-66de-4c9a-9178-764a32432931 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Returning 404 to user: Instance 1cc16fc2-454c-4941-8709-fc424d36d88c could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:39:31.055462 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8969d763-66de-4c9a-9178-764a32432931 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c" status: 404 len: 111 microversion: 2.1 time: 0.032131 Jun 30 16:39:31.055462 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 374/759] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:31 2022] GET /compute/v2.1/servers/1cc16fc2-454c-4941-8709-fc424d36d88c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:39:31.060101 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-59b83d3c-6d48-4e9e-beb4-e8c789d267f2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:31.060592 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-59b83d3c-6d48-4e9e-beb4-e8c789d267f2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:31.066938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-59b83d3c-6d48-4e9e-beb4-e8c789d267f2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.067389 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-59b83d3c-6d48-4e9e-beb4-e8c789d267f2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.068390 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-59b83d3c-6d48-4e9e-beb4-e8c789d267f2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.069000 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-59b83d3c-6d48-4e9e-beb4-e8c789d267f2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.096274 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-59b83d3c-6d48-4e9e-beb4-e8c789d267f2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Going to try to terminate instance {{(pid=124815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:39:31.273251 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f52a9464-440c-48d1-84ed-e87ed3a0ef0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:31.274101 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f52a9464-440c-48d1-84ed-e87ed3a0ef0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:31.280549 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f52a9464-440c-48d1-84ed-e87ed3a0ef0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.280988 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f52a9464-440c-48d1-84ed-e87ed3a0ef0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.281746 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f52a9464-440c-48d1-84ed-e87ed3a0ef0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.282177 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f52a9464-440c-48d1-84ed-e87ed3a0ef0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.313560 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f52a9464-440c-48d1-84ed-e87ed3a0ef0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045614 Jun 30 16:39:31.314243 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 375/760] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:39:31 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 30 16:39:31.388513 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2b7e2b38-845e-4e2b-befa-a39fab0d8bee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:31.389007 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2b7e2b38-845e-4e2b-befa-a39fab0d8bee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:31.395560 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2b7e2b38-845e-4e2b-befa-a39fab0d8bee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.396015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2b7e2b38-845e-4e2b-befa-a39fab0d8bee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.398089 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2b7e2b38-845e-4e2b-befa-a39fab0d8bee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.398532 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2b7e2b38-845e-4e2b-befa-a39fab0d8bee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.429099 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2b7e2b38-845e-4e2b-befa-a39fab0d8bee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Going to try to terminate instance {{(pid=124814) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:39:31.435419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-59b83d3c-6d48-4e9e-beb4-e8c789d267f2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 204 len: 0 microversion: 2.1 time: 0.378958 Jun 30 16:39:31.437171 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 386/761] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:39:31 2022] DELETE /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:39:31.452513 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-059abb47-f2dc-4d54-892e-4af0a9cfade3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:31.452513 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-059abb47-f2dc-4d54-892e-4af0a9cfade3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:31.456507 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-059abb47-f2dc-4d54-892e-4af0a9cfade3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.457541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-059abb47-f2dc-4d54-892e-4af0a9cfade3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.458565 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-059abb47-f2dc-4d54-892e-4af0a9cfade3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.459302 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-059abb47-f2dc-4d54-892e-4af0a9cfade3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.625381 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-059abb47-f2dc-4d54-892e-4af0a9cfade3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:31.634116 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-059abb47-f2dc-4d54-892e-4af0a9cfade3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.192682 Jun 30 16:39:31.634495 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 387/762] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:31 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:31.638991 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8aa9cca1-fc39-48a7-be43-ee5c3c531627 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:31.639631 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8aa9cca1-fc39-48a7-be43-ee5c3c531627 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:31.645677 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8aa9cca1-fc39-48a7-be43-ee5c3c531627 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.646123 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8aa9cca1-fc39-48a7-be43-ee5c3c531627 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.647690 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8aa9cca1-fc39-48a7-be43-ee5c3c531627 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.648144 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8aa9cca1-fc39-48a7-be43-ee5c3c531627 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.778868 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2b7e2b38-845e-4e2b-befa-a39fab0d8bee tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 204 len: 0 microversion: 2.1 time: 0.393899 Jun 30 16:39:31.782990 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 376/763] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:39:31 2022] DELETE /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 30 16:39:31.789055 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-63243d85-3efb-4fb9-b827-9903e5b0b9d1 req-4d0f5bec-0e85-4ccb-969a-ee059e4daa3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa43141-bf18-4671-bcfe-fcc4b0b32da0", "tag": "0a9fbc7b-f598-4597-8eb4-e0ab9c795a44"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:31.798078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-63243d85-3efb-4fb9-b827-9903e5b0b9d1 req-4d0f5bec-0e85-4ccb-969a-ee059e4daa3b service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.798865 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-63243d85-3efb-4fb9-b827-9903e5b0b9d1 req-4d0f5bec-0e85-4ccb-969a-ee059e4daa3b service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.812541 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-63243d85-3efb-4fb9-b827-9903e5b0b9d1 req-4d0f5bec-0e85-4ccb-969a-ee059e4daa3b service nova] Creating event network-changed:0a9fbc7b-f598-4597-8eb4-e0ab9c795a44 for instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 on hv-cinder-83602 Jun 30 16:39:31.817807 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-63243d85-3efb-4fb9-b827-9903e5b0b9d1 req-4d0f5bec-0e85-4ccb-969a-ee059e4daa3b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033238 Jun 30 16:39:31.818982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 377/764] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:31.824351 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a422d135-58e4-4528-84ea-9e623943c27d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:31.825019 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a422d135-58e4-4528-84ea-9e623943c27d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:31.831853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a422d135-58e4-4528-84ea-9e623943c27d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.832784 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a422d135-58e4-4528-84ea-9e623943c27d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.834892 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a422d135-58e4-4528-84ea-9e623943c27d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:31.835336 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a422d135-58e4-4528-84ea-9e623943c27d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:31.859957 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8aa9cca1-fc39-48a7-be43-ee5c3c531627 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:31.868702 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8aa9cca1-fc39-48a7-be43-ee5c3c531627 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1363 microversion: 2.1 time: 0.233140 Jun 30 16:39:31.869747 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 388/765] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:31 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:31.977892 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a422d135-58e4-4528-84ea-9e623943c27d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:31.985608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a422d135-58e4-4528-84ea-9e623943c27d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1682 microversion: 2.1 time: 0.165311 Jun 30 16:39:31.986173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 378/766] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:31 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:32.654954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-cdb4c615-0d39-47b2-a330-c3e69204d08a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:32.655599 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-cdb4c615-0d39-47b2-a330-c3e69204d08a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:32.663249 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cdb4c615-0d39-47b2-a330-c3e69204d08a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:32.663747 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cdb4c615-0d39-47b2-a330-c3e69204d08a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:32.664514 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cdb4c615-0d39-47b2-a330-c3e69204d08a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:32.664949 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cdb4c615-0d39-47b2-a330-c3e69204d08a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:32.799383 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-cdb4c615-0d39-47b2-a330-c3e69204d08a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:32.808019 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-cdb4c615-0d39-47b2-a330-c3e69204d08a tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.156967 Jun 30 16:39:32.808586 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 389/767] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:32 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:32.885996 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-b0389bc1-e5f9-42e5-a234-471a18a22a2c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:32.886553 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-b0389bc1-e5f9-42e5-a234-471a18a22a2c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:32.893242 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b0389bc1-e5f9-42e5-a234-471a18a22a2c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:32.894571 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b0389bc1-e5f9-42e5-a234-471a18a22a2c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:32.894571 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b0389bc1-e5f9-42e5-a234-471a18a22a2c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:32.895092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b0389bc1-e5f9-42e5-a234-471a18a22a2c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:32.897898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:33.003937 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-10755e05-b8a2-4628-88e0-6a1e32329a41 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:33.004567 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-10755e05-b8a2-4628-88e0-6a1e32329a41 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:33.011943 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-10755e05-b8a2-4628-88e0-6a1e32329a41 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:33.012396 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-10755e05-b8a2-4628-88e0-6a1e32329a41 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:33.013173 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-10755e05-b8a2-4628-88e0-6a1e32329a41 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:33.013608 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-10755e05-b8a2-4628-88e0-6a1e32329a41 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:33.033019 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b0389bc1-e5f9-42e5-a234-471a18a22a2c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:33.041916 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-b0389bc1-e5f9-42e5-a234-471a18a22a2c tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1363 microversion: 2.1 time: 0.159846 Jun 30 16:39:33.042491 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 379/768] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:32 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:33.149225 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-10755e05-b8a2-4628-88e0-6a1e32329a41 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:33.157032 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-10755e05-b8a2-4628-88e0-6a1e32329a41 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1682 microversion: 2.1 time: 0.157546 Jun 30 16:39:33.158272 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 390/769] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:32 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:33.825618 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7dae0b53-545c-4ab7-8e38-bf9c06b48eb6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:33.826230 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7dae0b53-545c-4ab7-8e38-bf9c06b48eb6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:33.832652 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7dae0b53-545c-4ab7-8e38-bf9c06b48eb6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:33.833134 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7dae0b53-545c-4ab7-8e38-bf9c06b48eb6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:33.833988 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7dae0b53-545c-4ab7-8e38-bf9c06b48eb6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:33.834504 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7dae0b53-545c-4ab7-8e38-bf9c06b48eb6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:33.969726 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7dae0b53-545c-4ab7-8e38-bf9c06b48eb6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:33.977548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7dae0b53-545c-4ab7-8e38-bf9c06b48eb6 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.155744 Jun 30 16:39:33.978111 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 380/770] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:33 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:34.059394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f60a7415-ed5b-4f57-b6ce-16b9c6850bdf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:34.060066 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f60a7415-ed5b-4f57-b6ce-16b9c6850bdf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:34.066591 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f60a7415-ed5b-4f57-b6ce-16b9c6850bdf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:34.067043 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f60a7415-ed5b-4f57-b6ce-16b9c6850bdf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:34.067835 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f60a7415-ed5b-4f57-b6ce-16b9c6850bdf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:34.068971 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f60a7415-ed5b-4f57-b6ce-16b9c6850bdf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:34.175416 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-12e05669-b03d-4369-b3e4-3c8c207acc9a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:34.176146 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-12e05669-b03d-4369-b3e4-3c8c207acc9a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:34.182822 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12e05669-b03d-4369-b3e4-3c8c207acc9a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:34.183290 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12e05669-b03d-4369-b3e4-3c8c207acc9a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:34.184333 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12e05669-b03d-4369-b3e4-3c8c207acc9a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:34.184783 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12e05669-b03d-4369-b3e4-3c8c207acc9a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:34.201010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f60a7415-ed5b-4f57-b6ce-16b9c6850bdf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:34.208443 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f60a7415-ed5b-4f57-b6ce-16b9c6850bdf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1363 microversion: 2.1 time: 0.153244 Jun 30 16:39:34.209078 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 391/771] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:34 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:34.317891 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-12e05669-b03d-4369-b3e4-3c8c207acc9a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:34.325404 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-12e05669-b03d-4369-b3e4-3c8c207acc9a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1682 microversion: 2.1 time: 0.153909 Jun 30 16:39:34.325975 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 381/772] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:34 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:34.994352 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d9d733f7-7de8-4802-89b0-adb104f9247d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:34.995239 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d9d733f7-7de8-4802-89b0-adb104f9247d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:35.001857 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d9d733f7-7de8-4802-89b0-adb104f9247d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:35.002031 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d9d733f7-7de8-4802-89b0-adb104f9247d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:35.002818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d9d733f7-7de8-4802-89b0-adb104f9247d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:35.003259 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d9d733f7-7de8-4802-89b0-adb104f9247d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:35.137202 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d9d733f7-7de8-4802-89b0-adb104f9247d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:35.144798 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d9d733f7-7de8-4802-89b0-adb104f9247d tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1520 microversion: 2.1 time: 0.154611 Jun 30 16:39:35.145355 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 392/773] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:34 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:35.226261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-13bd9f6d-965c-47b0-9f67-ed34a3cfa146 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:35.226261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-13bd9f6d-965c-47b0-9f67-ed34a3cfa146 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:35.233762 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-13bd9f6d-965c-47b0-9f67-ed34a3cfa146 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:35.234136 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-13bd9f6d-965c-47b0-9f67-ed34a3cfa146 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:35.234904 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-13bd9f6d-965c-47b0-9f67-ed34a3cfa146 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:35.235332 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-13bd9f6d-965c-47b0-9f67-ed34a3cfa146 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:35.342261 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9431418b-b0ed-4925-bee7-fa14a42aae8e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:35.342878 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9431418b-b0ed-4925-bee7-fa14a42aae8e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:35.348902 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9431418b-b0ed-4925-bee7-fa14a42aae8e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:35.349362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9431418b-b0ed-4925-bee7-fa14a42aae8e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:35.350322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9431418b-b0ed-4925-bee7-fa14a42aae8e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:35.350786 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9431418b-b0ed-4925-bee7-fa14a42aae8e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:35.498945 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-13bd9f6d-965c-47b0-9f67-ed34a3cfa146 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:35.507943 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-13bd9f6d-965c-47b0-9f67-ed34a3cfa146 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1363 microversion: 2.1 time: 0.286482 Jun 30 16:39:35.508544 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 382/774] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:35 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:35.542855 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9431418b-b0ed-4925-bee7-fa14a42aae8e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:35.550920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9431418b-b0ed-4925-bee7-fa14a42aae8e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1682 microversion: 2.1 time: 0.212457 Jun 30 16:39:35.551915 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 393/775] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:35 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:36.163498 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0f898be1-abb8-40ec-9da7-ebfe6d9376d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:36.164154 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0f898be1-abb8-40ec-9da7-ebfe6d9376d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:36.168582 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:36.171048 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0f898be1-abb8-40ec-9da7-ebfe6d9376d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:36.171526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0f898be1-abb8-40ec-9da7-ebfe6d9376d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:36.172313 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0f898be1-abb8-40ec-9da7-ebfe6d9376d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:36.172748 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0f898be1-abb8-40ec-9da7-ebfe6d9376d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:36.245280 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0f898be1-abb8-40ec-9da7-ebfe6d9376d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:36.253606 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0f898be1-abb8-40ec-9da7-ebfe6d9376d3 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1478 microversion: 2.1 time: 0.094763 Jun 30 16:39:36.254692 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 383/776] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:36 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1478 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:36.300404 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-b01a7e97-9740-4853-ac57-91339c506f6e req-2aadd64e-1c4f-4542-805c-b6b615ac1aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ce60666-aa28-4c5d-b893-faa7f10a777b", "name": "network-vif-deleted", "tag": "8d6b84f1-0b05-4d2b-8419-4c63e8ef22b1"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:36.304176 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:36.304886 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=12 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:36.310889 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-b01a7e97-9740-4853-ac57-91339c506f6e req-2aadd64e-1c4f-4542-805c-b6b615ac1aa7 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:36.311339 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-b01a7e97-9740-4853-ac57-91339c506f6e req-2aadd64e-1c4f-4542-805c-b6b615ac1aa7 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:36.326672 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-b01a7e97-9740-4853-ac57-91339c506f6e req-2aadd64e-1c4f-4542-805c-b6b615ac1aa7 service nova] Creating event network-vif-deleted:8d6b84f1-0b05-4d2b-8419-4c63e8ef22b1 for instance 6ce60666-aa28-4c5d-b893-faa7f10a777b on hv-cinder-83602 Jun 30 16:39:36.329426 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-b01a7e97-9740-4853-ac57-91339c506f6e req-2aadd64e-1c4f-4542-805c-b6b615ac1aa7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032830 Jun 30 16:39:36.330102 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 394/777] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:36.525744 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ddc7aa6f-b572-49d4-8214-b0c2451f23bb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:36.526362 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ddc7aa6f-b572-49d4-8214-b0c2451f23bb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:36.533390 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ddc7aa6f-b572-49d4-8214-b0c2451f23bb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:36.533835 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ddc7aa6f-b572-49d4-8214-b0c2451f23bb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:36.535729 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ddc7aa6f-b572-49d4-8214-b0c2451f23bb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:36.536393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ddc7aa6f-b572-49d4-8214-b0c2451f23bb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:36.574699 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b13d96b0-4b2a-47b2-b830-c727174f8a0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:36.575734 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b13d96b0-4b2a-47b2-b830-c727174f8a0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:36.585300 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b13d96b0-4b2a-47b2-b830-c727174f8a0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:36.586223 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b13d96b0-4b2a-47b2-b830-c727174f8a0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:36.587745 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b13d96b0-4b2a-47b2-b830-c727174f8a0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:36.588469 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b13d96b0-4b2a-47b2-b830-c727174f8a0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:36.685847 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b13d96b0-4b2a-47b2-b830-c727174f8a0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:36.696235 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b13d96b0-4b2a-47b2-b830-c727174f8a0d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1614 microversion: 2.1 time: 0.130798 Jun 30 16:39:36.705944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 395/778] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:36 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1614 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:36.730178 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ddc7aa6f-b572-49d4-8214-b0c2451f23bb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:36.738929 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ddc7aa6f-b572-49d4-8214-b0c2451f23bb tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1363 microversion: 2.1 time: 0.217888 Jun 30 16:39:36.739847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 384/779] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:36 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:37.270368 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-77d61581-e828-497f-931a-6adeff3c9313 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:37.271322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-77d61581-e828-497f-931a-6adeff3c9313 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:37.277873 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-77d61581-e828-497f-931a-6adeff3c9313 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:37.278456 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-77d61581-e828-497f-931a-6adeff3c9313 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:37.279760 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-77d61581-e828-497f-931a-6adeff3c9313 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:37.280207 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-77d61581-e828-497f-931a-6adeff3c9313 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:37.314850 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-77d61581-e828-497f-931a-6adeff3c9313 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:37.315527 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-77d61581-e828-497f-931a-6adeff3c9313 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:37.315801 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-77d61581-e828-497f-931a-6adeff3c9313 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lazy-loading 'fault' on Instance uuid 6ce60666-aa28-4c5d-b893-faa7f10a777b {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:39:37.360426 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-77d61581-e828-497f-931a-6adeff3c9313 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2de23770f4374decb95ff94f3e7f793b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839a189179c543c6a704a968170ec022', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:37.368764 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-77d61581-e828-497f-931a-6adeff3c9313 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 200 len: 1312 microversion: 2.1 time: 0.102310 Jun 30 16:39:37.369369 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 396/780] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:37 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:37.714680 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-10f1bc12-5aae-4061-8985-ee5df4d625fb tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:37.715315 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-10f1bc12-5aae-4061-8985-ee5df4d625fb tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:37.722483 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10f1bc12-5aae-4061-8985-ee5df4d625fb tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:37.722921 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10f1bc12-5aae-4061-8985-ee5df4d625fb tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:37.723726 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10f1bc12-5aae-4061-8985-ee5df4d625fb tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:37.724184 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10f1bc12-5aae-4061-8985-ee5df4d625fb tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:37.756239 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6e0995f3-e6a3-4f60-aa95-536e8b29e60f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:37.757016 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6e0995f3-e6a3-4f60-aa95-536e8b29e60f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:37.757136 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10f1bc12-5aae-4061-8985-ee5df4d625fb tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:37.757427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10f1bc12-5aae-4061-8985-ee5df4d625fb tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:37.757883 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-10f1bc12-5aae-4061-8985-ee5df4d625fb tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lazy-loading 'fault' on Instance uuid 4eddee8f-330d-43f7-8877-50a589622e55 {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:39:37.762884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6e0995f3-e6a3-4f60-aa95-536e8b29e60f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:37.763351 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6e0995f3-e6a3-4f60-aa95-536e8b29e60f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:37.764198 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6e0995f3-e6a3-4f60-aa95-536e8b29e60f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:37.764635 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6e0995f3-e6a3-4f60-aa95-536e8b29e60f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:37.801156 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-10f1bc12-5aae-4061-8985-ee5df4d625fb tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:37.809829 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-10f1bc12-5aae-4061-8985-ee5df4d625fb tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 200 len: 1332 microversion: 2.1 time: 0.099478 Jun 30 16:39:37.810399 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 385/781] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:37 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:37.915068 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6e0995f3-e6a3-4f60-aa95-536e8b29e60f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:37.917380 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:37.923518 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6e0995f3-e6a3-4f60-aa95-536e8b29e60f tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1363 microversion: 2.1 time: 0.171044 Jun 30 16:39:37.924326 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 397/782] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:37 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:38.344103 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-bbb8cc3d-5c8b-4317-9dc1-2eeb9f9378f6 req-36bf6836-5cf9-499e-8ee1-eed5d7c28e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eddee8f-330d-43f7-8877-50a589622e55", "name": "network-vif-deleted", "tag": "11b309b0-51ca-464b-a5e0-614725a89fdb"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:38.352749 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-bbb8cc3d-5c8b-4317-9dc1-2eeb9f9378f6 req-36bf6836-5cf9-499e-8ee1-eed5d7c28e73 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:38.353183 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-bbb8cc3d-5c8b-4317-9dc1-2eeb9f9378f6 req-36bf6836-5cf9-499e-8ee1-eed5d7c28e73 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:38.366178 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-bbb8cc3d-5c8b-4317-9dc1-2eeb9f9378f6 req-36bf6836-5cf9-499e-8ee1-eed5d7c28e73 service nova] Creating event network-vif-deleted:11b309b0-51ca-464b-a5e0-614725a89fdb for instance 4eddee8f-330d-43f7-8877-50a589622e55 on hv-cinder-83602 Jun 30 16:39:38.371225 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-bbb8cc3d-5c8b-4317-9dc1-2eeb9f9378f6 req-36bf6836-5cf9-499e-8ee1-eed5d7c28e73 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031192 Jun 30 16:39:38.371680 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 386/783] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:38.386145 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b07ab7a5-d8ff-4a44-a06d-8e3b408e0fb2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:38.386953 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b07ab7a5-d8ff-4a44-a06d-8e3b408e0fb2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] [instance: 6ce60666-aa28-4c5d-b893-faa7f10a777b] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:38.394175 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b07ab7a5-d8ff-4a44-a06d-8e3b408e0fb2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:38.394636 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b07ab7a5-d8ff-4a44-a06d-8e3b408e0fb2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:38.395410 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b07ab7a5-d8ff-4a44-a06d-8e3b408e0fb2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:38.395966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b07ab7a5-d8ff-4a44-a06d-8e3b408e0fb2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:38.412853 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-b07ab7a5-d8ff-4a44-a06d-8e3b408e0fb2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] HTTP exception thrown: Instance 6ce60666-aa28-4c5d-b893-faa7f10a777b could not be found. Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b07ab7a5-d8ff-4a44-a06d-8e3b408e0fb2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Request method failure captured: Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b HTTP/1.1 Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdBwM9qvHtOnFqUQDtbBU25dM8LsDJJTw1pxd--fjd3blMXEcKPhQWZ-a27FdgjxBMK6dTUcUQH6ay8X0VGGzhyFlL71iFHTgsLgL0YYMg5CBUCtAhR-PSa6BNDD22qbdj4XsHc-GH7-1ZaAlg1BvKwRS17UakMMM4b-BX-kEr6NtA0 Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: 839a189179c543c6a704a968170ec022 Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:39:38.414499 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:39:38.416039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/839a189179c543c6a704a968170ec022"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/839a189179c543c6a704a968170ec022"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_839a189179c543c6a704a968170ec022"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/839a189179c543c6a704a968170ec022"}]}] Jun 30 16:39:38.416039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:39:38.416039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: 839a189179c543c6a704a968170ec022 Jun 30 16:39:38.416039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1419143453 Jun 30 16:39:38.416039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-ServerRescueNegativeTestJSON-1419143453-project Jun 30 16:39:38.416039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:39:38.416039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:39:38.416039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 2de23770f4374decb95ff94f3e7f793b Jun 30 16:39:38.416039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1419143453-project Jun 30 16:39:38.416039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:39:38.416039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance 6ce60666-aa28-4c5d-b893-faa7f10a777b could not be found. Jun 30 16:39:38.416039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': '6ce60666-aa28-4c5d-b893-faa7f10a777b'} Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ce60666-aa28-4c5d-b893-faa7f10a777b could not be found. Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:39:38.416938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ce60666-aa28-4c5d-b893-faa7f10a777b could not be found. Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ce60666-aa28-4c5d-b893-faa7f10a777b could not be found. Jun 30 16:39:38.418155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:39:38.419228 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b07ab7a5-d8ff-4a44-a06d-8e3b408e0fb2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] Returning 404 to user: Instance 6ce60666-aa28-4c5d-b893-faa7f10a777b could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:39:38.419228 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b07ab7a5-d8ff-4a44-a06d-8e3b408e0fb2 tempest-ServerRescueNegativeTestJSON-1419143453 tempest-ServerRescueNegativeTestJSON-1419143453-project] 10.222.0.67 "GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b" status: 404 len: 111 microversion: 2.1 time: 0.034855 Jun 30 16:39:38.419228 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 398/784] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:38 2022] GET /compute/v2.1/servers/6ce60666-aa28-4c5d-b893-faa7f10a777b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:39:38.828966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7765cdc5-1b3b-4501-b07b-5c54fb1d2fff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:38.829831 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7765cdc5-1b3b-4501-b07b-5c54fb1d2fff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:38.837762 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7765cdc5-1b3b-4501-b07b-5c54fb1d2fff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:38.838291 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7765cdc5-1b3b-4501-b07b-5c54fb1d2fff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:38.847706 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7765cdc5-1b3b-4501-b07b-5c54fb1d2fff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:38.847706 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7765cdc5-1b3b-4501-b07b-5c54fb1d2fff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:38.855964 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-7765cdc5-1b3b-4501-b07b-5c54fb1d2fff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] HTTP exception thrown: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7765cdc5-1b3b-4501-b07b-5c54fb1d2fff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Request method failure captured: Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 HTTP/1.1 Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdByCRmKHFn3MWHXG9FHLumdqoFbcitofz3WTo4vIsqDgEdQTbCYdYkG6VrKJfwKSwNBul_mR6Pq6q8wsCNMbsOQVU-vBawcL74Th9xNCcWYhdHHThpX8bYg_ks1_lfyxu2cd7ltcDmgXQzda0-vc83XxV9QJd6mMtTnGfzh1bTh8BQ Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:39:38.857727 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:39:38.859029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f942ab31bafc428bb1fba94aee2e0c32"}]}] Jun 30 16:39:38.859029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:39:38.859029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:39:38.859029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:39:38.859029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:39:38.859029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:39:38.859029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:39:38.859029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 0a26028451b345968fe86774f44736dd Jun 30 16:39:38.859029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:39:38.859029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:39:38.859029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:39:38.859029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': '4eddee8f-330d-43f7-8877-50a589622e55'} Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:39:38.859982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:39:38.861381 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:39:38.862663 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7765cdc5-1b3b-4501-b07b-5c54fb1d2fff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Returning 404 to user: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:39:38.862663 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7765cdc5-1b3b-4501-b07b-5c54fb1d2fff tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 404 len: 111 microversion: 2.1 time: 0.035234 Jun 30 16:39:38.869149 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 387/785] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:38 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:39:38.869873 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-163e5848-f8f1-4df0-968d-406ccfbded84 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '.version_select at 0x7f38200b65e0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:38.941387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-55f098a8-3f79-4d3b-8991-f7d56a32b111 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:38.944688 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-55f098a8-3f79-4d3b-8991-f7d56a32b111 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:38.948665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-55f098a8-3f79-4d3b-8991-f7d56a32b111 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:38.949117 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-55f098a8-3f79-4d3b-8991-f7d56a32b111 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:38.949898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-55f098a8-3f79-4d3b-8991-f7d56a32b111 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:38.950343 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-55f098a8-3f79-4d3b-8991-f7d56a32b111 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:39.008208 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-163e5848-f8f1-4df0-968d-406ccfbded84 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022148847" status: 202 len: 0 microversion: 2.1 time: 0.138446 Jun 30 16:39:39.008924 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 399/786] 10.222.0.67 () {58 vars in 1220 bytes} [Thu Jun 30 16:39:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1022148847 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:39:39.168215 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-55f098a8-3f79-4d3b-8991-f7d56a32b111 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:39.176784 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-55f098a8-3f79-4d3b-8991-f7d56a32b111 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1363 microversion: 2.1 time: 0.239221 Jun 30 16:39:39.177565 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 388/787] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:38 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:39.899501 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7543e976-dbfe-4d54-8b97-32574765b112 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Action: 'create', calling method: .version_select at 0x7f38200b2280>, body: {"keypair": {"name": "tempest-keypair-2019523306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArnl2OmhKl7BBEPDDl+uRPuoCXm3V6Xbg7ajAIAwDU6fDr1tvpJWPJI//Jxar8Ph9Il8a50ynIXicp5mDcPzPujqU5S4ezSFjmDHG7DyCAPyK7Z2DxcT+SnGUNkZ1VMUg=="}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:39.915486 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-7543e976-dbfe-4d54-8b97-32574765b112 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'key_pairs'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:39:39.921453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-7543e976-dbfe-4d54-8b97-32574765b112 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for user 0a26028451b345968fe86774f44736dd and project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'key_pairs'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:39:40.037015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7543e976-dbfe-4d54-8b97-32574765b112 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142813 Jun 30 16:39:40.038580 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 400/788] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 30 16:39:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:40.195914 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-28e749a1-1a7d-4394-af2a-5357d4b81106 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:40.197235 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-28e749a1-1a7d-4394-af2a-5357d4b81106 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:40.203645 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-28e749a1-1a7d-4394-af2a-5357d4b81106 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:40.204299 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-28e749a1-1a7d-4394-af2a-5357d4b81106 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:40.205074 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-28e749a1-1a7d-4394-af2a-5357d4b81106 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:40.205697 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-28e749a1-1a7d-4394-af2a-5357d4b81106 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:40.382053 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-28e749a1-1a7d-4394-af2a-5357d4b81106 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:40.390771 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-28e749a1-1a7d-4394-af2a-5357d4b81106 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1363 microversion: 2.1 time: 0.199536 Jun 30 16:39:40.391350 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 389/789] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:40 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:40.978620 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-b944fa09-f865-4e53-ba95-702254c36ba4 req-f721a83e-d320-4307-94a1-abf25f338bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa43141-bf18-4671-bcfe-fcc4b0b32da0", "name": "network-vif-plugged", "status": "completed", "tag": "0a9fbc7b-f598-4597-8eb4-e0ab9c795a44"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:40.988404 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-b944fa09-f865-4e53-ba95-702254c36ba4 req-f721a83e-d320-4307-94a1-abf25f338bfa service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:40.988860 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-b944fa09-f865-4e53-ba95-702254c36ba4 req-f721a83e-d320-4307-94a1-abf25f338bfa service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:41.001683 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-b944fa09-f865-4e53-ba95-702254c36ba4 req-f721a83e-d320-4307-94a1-abf25f338bfa service nova] Creating event network-vif-plugged:0a9fbc7b-f598-4597-8eb4-e0ab9c795a44 for instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 on hv-cinder-83602 Jun 30 16:39:41.011458 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-b944fa09-f865-4e53-ba95-702254c36ba4 req-f721a83e-d320-4307-94a1-abf25f338bfa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107363 Jun 30 16:39:41.012393 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 401/790] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:41.415851 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7a5942c8-1cf6-4f3e-9445-f33d985e9672 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:41.416611 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7a5942c8-1cf6-4f3e-9445-f33d985e9672 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:41.427145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7a5942c8-1cf6-4f3e-9445-f33d985e9672 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:41.427758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7a5942c8-1cf6-4f3e-9445-f33d985e9672 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:41.428829 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7a5942c8-1cf6-4f3e-9445-f33d985e9672 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:41.430957 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7a5942c8-1cf6-4f3e-9445-f33d985e9672 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:41.885781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7a5942c8-1cf6-4f3e-9445-f33d985e9672 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:41.927553 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7a5942c8-1cf6-4f3e-9445-f33d985e9672 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1363 microversion: 2.1 time: 0.517939 Jun 30 16:39:41.929079 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 390/791] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:41 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1363 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:42.941427 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-792123144", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "16892394-e408-48ab-985b-412d1c45e5c5"}], "security_groups": [{"name": "tempest-securitygroup--2093468410"}], "key_name": "tempest-keypair-2019523306", "user_data": "}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:42.946342 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4009c974-cb90-41a0-8018-fd0bf11c9d33 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:42.946959 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4009c974-cb90-41a0-8018-fd0bf11c9d33 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:42.953735 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4009c974-cb90-41a0-8018-fd0bf11c9d33 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:42.954193 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4009c974-cb90-41a0-8018-fd0bf11c9d33 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:42.954975 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4009c974-cb90-41a0-8018-fd0bf11c9d33 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:42.955418 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4009c974-cb90-41a0-8018-fd0bf11c9d33 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:43.113354 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.network.neutron [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] validate_networks() for [('16892394-e408-48ab-985b-412d1c45e5c5', None, None, None, None, None)] {{(pid=124815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:39:43.204750 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4009c974-cb90-41a0-8018-fd0bf11c9d33 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:43.212430 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-4009c974-cb90-41a0-8018-fd0bf11c9d33 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1363 microversion: 2.1 time: 0.270681 Jun 30 16:39:43.213122 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 391/792] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:42 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:43.548850 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Flavor limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:39:43.549274 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Image limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:39:43.549753 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Flavor pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:39:43.550164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Image pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:39:43.550589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:39:43.560636 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:43.561090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:43.561893 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:43.562336 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:43.582450 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:39:43.587039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Getting quotas for user 0a26028451b345968fe86774f44736dd and project f942ab31bafc428bb1fba94aee2e0c32. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:39:43.598533 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Going to run 1 instances... {{(pid=124815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:39:43.601610 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:39:43.717840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-4e63b68b-3b6c-4492-b3d9-51f64c4dc6db tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.781088 Jun 30 16:39:43.718633 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 402/793] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:39:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 16:39:43.729691 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5ee366fd-3df2-4af6-9947-8fa2f74ea943 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:43.730367 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5ee366fd-3df2-4af6-9947-8fa2f74ea943 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:43.789202 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5ee366fd-3df2-4af6-9947-8fa2f74ea943 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:43.796327 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5ee366fd-3df2-4af6-9947-8fa2f74ea943 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1241 microversion: 2.1 time: 0.071316 Jun 30 16:39:43.797054 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 392/794] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:43 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:44.234556 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-68236fe9-203a-413f-9ff5-a76c8a764b2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:44.235180 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-68236fe9-203a-413f-9ff5-a76c8a764b2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:44.242895 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-68236fe9-203a-413f-9ff5-a76c8a764b2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:44.243237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-68236fe9-203a-413f-9ff5-a76c8a764b2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:44.244331 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-68236fe9-203a-413f-9ff5-a76c8a764b2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:44.244780 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-68236fe9-203a-413f-9ff5-a76c8a764b2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:44.395791 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-68236fe9-203a-413f-9ff5-a76c8a764b2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:44.406434 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-68236fe9-203a-413f-9ff5-a76c8a764b2e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1548 microversion: 2.1 time: 0.176722 Jun 30 16:39:44.407413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 403/795] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:44 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:44.423049 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-263ad3cc-211e-4664-bbc3-779b4ad71db9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:44.423837 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-263ad3cc-211e-4664-bbc3-779b4ad71db9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:44.430966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-263ad3cc-211e-4664-bbc3-779b4ad71db9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:44.431414 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-263ad3cc-211e-4664-bbc3-779b4ad71db9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:44.432220 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-263ad3cc-211e-4664-bbc3-779b4ad71db9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:44.432661 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-263ad3cc-211e-4664-bbc3-779b4ad71db9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:44.515445 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-263ad3cc-211e-4664-bbc3-779b4ad71db9 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096326 Jun 30 16:39:44.516166 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 393/796] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 30 16:39:44 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:39:44.816347 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-66d7a921-3be3-432e-9061-28f91d151607 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:44.817319 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-66d7a921-3be3-432e-9061-28f91d151607 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:44.825043 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66d7a921-3be3-432e-9061-28f91d151607 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:44.825500 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66d7a921-3be3-432e-9061-28f91d151607 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:44.826311 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66d7a921-3be3-432e-9061-28f91d151607 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:44.826747 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66d7a921-3be3-432e-9061-28f91d151607 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:44.960665 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-66d7a921-3be3-432e-9061-28f91d151607 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:44.969574 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-66d7a921-3be3-432e-9061-28f91d151607 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1245 microversion: 2.1 time: 0.157905 Jun 30 16:39:44.970287 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 404/797] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:44 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1245 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:45.617940 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-4a345c6a-2c6b-4754-a251-2a242b7d158b req-219872fd-88e7-4260-a6a2-560d633746d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa43141-bf18-4671-bcfe-fcc4b0b32da0", "tag": "0a9fbc7b-f598-4597-8eb4-e0ab9c795a44"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:45.626825 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-4a345c6a-2c6b-4754-a251-2a242b7d158b req-219872fd-88e7-4260-a6a2-560d633746d6 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:45.627275 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-4a345c6a-2c6b-4754-a251-2a242b7d158b req-219872fd-88e7-4260-a6a2-560d633746d6 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:45.642518 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-4a345c6a-2c6b-4754-a251-2a242b7d158b req-219872fd-88e7-4260-a6a2-560d633746d6 service nova] Creating event network-changed:0a9fbc7b-f598-4597-8eb4-e0ab9c795a44 for instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 on hv-cinder-83602 Jun 30 16:39:45.661299 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-4a345c6a-2c6b-4754-a251-2a242b7d158b req-219872fd-88e7-4260-a6a2-560d633746d6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048048 Jun 30 16:39:45.662328 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 394/798] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:45.990475 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8e247dc6-4916-4e6b-b62b-ac08bb2dd727 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:45.993482 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8e247dc6-4916-4e6b-b62b-ac08bb2dd727 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:46.010800 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8e247dc6-4916-4e6b-b62b-ac08bb2dd727 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:46.011445 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8e247dc6-4916-4e6b-b62b-ac08bb2dd727 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:46.012473 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8e247dc6-4916-4e6b-b62b-ac08bb2dd727 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:46.013098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8e247dc6-4916-4e6b-b62b-ac08bb2dd727 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:46.093986 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8e247dc6-4916-4e6b-b62b-ac08bb2dd727 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:46.102889 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8e247dc6-4916-4e6b-b62b-ac08bb2dd727 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1299 microversion: 2.1 time: 0.119052 Jun 30 16:39:46.114446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 405/799] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:45 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1299 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:47.122816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f212ac4d-5d37-45bc-a834-d6a87cfbf8b9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:47.123894 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f212ac4d-5d37-45bc-a834-d6a87cfbf8b9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:47.132162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f212ac4d-5d37-45bc-a834-d6a87cfbf8b9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:47.132924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f212ac4d-5d37-45bc-a834-d6a87cfbf8b9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:47.134135 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f212ac4d-5d37-45bc-a834-d6a87cfbf8b9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:47.135458 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f212ac4d-5d37-45bc-a834-d6a87cfbf8b9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:47.383885 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f212ac4d-5d37-45bc-a834-d6a87cfbf8b9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:47.391888 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f212ac4d-5d37-45bc-a834-d6a87cfbf8b9 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1367 microversion: 2.1 time: 0.273534 Jun 30 16:39:47.392456 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 395/800] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:47 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:48.323165 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-469f13dc-0a2c-4746-b56d-00a88e12b1f8 req-c35c6334-7146-4e63-9e19-d50f9fa3229d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab43f806-fda4-432a-ac06-f950c83c9edf", "tag": "1b8b879d-fbe8-4d64-bc33-b23f193e7b6d"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:48.335613 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-469f13dc-0a2c-4746-b56d-00a88e12b1f8 req-c35c6334-7146-4e63-9e19-d50f9fa3229d service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:48.336455 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-469f13dc-0a2c-4746-b56d-00a88e12b1f8 req-c35c6334-7146-4e63-9e19-d50f9fa3229d service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:48.355776 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-469f13dc-0a2c-4746-b56d-00a88e12b1f8 req-c35c6334-7146-4e63-9e19-d50f9fa3229d service nova] Creating event network-changed:1b8b879d-fbe8-4d64-bc33-b23f193e7b6d for instance ab43f806-fda4-432a-ac06-f950c83c9edf on hv-cinder-83602 Jun 30 16:39:48.362350 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-469f13dc-0a2c-4746-b56d-00a88e12b1f8 req-c35c6334-7146-4e63-9e19-d50f9fa3229d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046787 Jun 30 16:39:48.363259 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 406/801] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:48.409858 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-dd4914d1-8436-4410-8512-937419c376d4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:48.410480 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-dd4914d1-8436-4410-8512-937419c376d4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:48.418480 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dd4914d1-8436-4410-8512-937419c376d4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:48.418943 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dd4914d1-8436-4410-8512-937419c376d4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:48.419810 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dd4914d1-8436-4410-8512-937419c376d4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:48.420442 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dd4914d1-8436-4410-8512-937419c376d4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:48.661682 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-dd4914d1-8436-4410-8512-937419c376d4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:48.671677 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-dd4914d1-8436-4410-8512-937419c376d4 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1367 microversion: 2.1 time: 0.266013 Jun 30 16:39:48.672636 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 396/802] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:48 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:49.690842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8d125ee3-90dd-44e3-b26a-1e09b581e4af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:49.691555 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8d125ee3-90dd-44e3-b26a-1e09b581e4af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:49.698248 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8d125ee3-90dd-44e3-b26a-1e09b581e4af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:49.698695 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8d125ee3-90dd-44e3-b26a-1e09b581e4af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:49.699452 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8d125ee3-90dd-44e3-b26a-1e09b581e4af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:49.699914 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8d125ee3-90dd-44e3-b26a-1e09b581e4af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:49.833065 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8d125ee3-90dd-44e3-b26a-1e09b581e4af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:49.841271 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8d125ee3-90dd-44e3-b26a-1e09b581e4af tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1367 microversion: 2.1 time: 0.154756 Jun 30 16:39:49.841777 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 407/803] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:49 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:50.858279 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d358566a-3e61-438b-884f-9e3f7a9a8d96 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:50.858945 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d358566a-3e61-438b-884f-9e3f7a9a8d96 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:50.865194 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d358566a-3e61-438b-884f-9e3f7a9a8d96 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:50.865652 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d358566a-3e61-438b-884f-9e3f7a9a8d96 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:50.866472 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d358566a-3e61-438b-884f-9e3f7a9a8d96 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:50.866986 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d358566a-3e61-438b-884f-9e3f7a9a8d96 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:51.008032 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d358566a-3e61-438b-884f-9e3f7a9a8d96 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:51.016211 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d358566a-3e61-438b-884f-9e3f7a9a8d96 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1367 microversion: 2.1 time: 0.161641 Jun 30 16:39:51.017055 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 397/804] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:50 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:52.034037 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-dcfa4fe0-ea91-4d01-b498-c3d87f9b5c18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:52.034647 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-dcfa4fe0-ea91-4d01-b498-c3d87f9b5c18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:52.044519 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dcfa4fe0-ea91-4d01-b498-c3d87f9b5c18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:52.044994 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dcfa4fe0-ea91-4d01-b498-c3d87f9b5c18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:52.045846 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dcfa4fe0-ea91-4d01-b498-c3d87f9b5c18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:52.046348 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dcfa4fe0-ea91-4d01-b498-c3d87f9b5c18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:52.191839 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-dcfa4fe0-ea91-4d01-b498-c3d87f9b5c18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:52.199291 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-dcfa4fe0-ea91-4d01-b498-c3d87f9b5c18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1367 microversion: 2.1 time: 0.169071 Jun 30 16:39:52.199919 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 408/805] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:52 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:52.943264 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-b8439796-22d6-42e6-b29a-020a8ed75a14 req-7ffb24e1-9a63-46a6-9e0d-f7b2c80358dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab43f806-fda4-432a-ac06-f950c83c9edf", "name": "network-vif-plugged", "status": "completed", "tag": "1b8b879d-fbe8-4d64-bc33-b23f193e7b6d"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:52.956656 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-b8439796-22d6-42e6-b29a-020a8ed75a14 req-7ffb24e1-9a63-46a6-9e0d-f7b2c80358dd service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:52.957119 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-b8439796-22d6-42e6-b29a-020a8ed75a14 req-7ffb24e1-9a63-46a6-9e0d-f7b2c80358dd service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:52.968714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-b8439796-22d6-42e6-b29a-020a8ed75a14 req-7ffb24e1-9a63-46a6-9e0d-f7b2c80358dd service nova] Creating event network-vif-plugged:1b8b879d-fbe8-4d64-bc33-b23f193e7b6d for instance ab43f806-fda4-432a-ac06-f950c83c9edf on hv-cinder-83602 Jun 30 16:39:52.973451 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-b8439796-22d6-42e6-b29a-020a8ed75a14 req-7ffb24e1-9a63-46a6-9e0d-f7b2c80358dd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038597 Jun 30 16:39:52.974452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 398/806] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:53.217359 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-808e2389-5b8a-4afc-97b3-e9ac8d40ca8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:53.218144 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-808e2389-5b8a-4afc-97b3-e9ac8d40ca8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:53.224733 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-808e2389-5b8a-4afc-97b3-e9ac8d40ca8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:53.225192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-808e2389-5b8a-4afc-97b3-e9ac8d40ca8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:53.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-808e2389-5b8a-4afc-97b3-e9ac8d40ca8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:53.229790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-808e2389-5b8a-4afc-97b3-e9ac8d40ca8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:53.375416 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-808e2389-5b8a-4afc-97b3-e9ac8d40ca8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:53.377755 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-808e2389-5b8a-4afc-97b3-e9ac8d40ca8d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1367 microversion: 2.1 time: 0.164489 Jun 30 16:39:53.378611 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 409/807] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:53 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:54.393282 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=2 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:54.398216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d046e36d-0076-433a-8c88-a372c13b3684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:54.400090 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d046e36d-0076-433a-8c88-a372c13b3684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:54.406650 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d046e36d-0076-433a-8c88-a372c13b3684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:54.407095 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d046e36d-0076-433a-8c88-a372c13b3684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:54.408015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d046e36d-0076-433a-8c88-a372c13b3684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:54.408447 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d046e36d-0076-433a-8c88-a372c13b3684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:54.423695 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=100 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:54.555115 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d046e36d-0076-433a-8c88-a372c13b3684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:54.563730 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d046e36d-0076-433a-8c88-a372c13b3684 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1367 microversion: 2.1 time: 0.171320 Jun 30 16:39:54.564323 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 399/808] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:54 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:39:55.581803 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b1ca8651-a1f7-4071-b51d-0fd9f62fab18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:55.582482 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b1ca8651-a1f7-4071-b51d-0fd9f62fab18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:55.585494 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:55.586697 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=10 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:39:55.590850 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b1ca8651-a1f7-4071-b51d-0fd9f62fab18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:55.591300 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b1ca8651-a1f7-4071-b51d-0fd9f62fab18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:55.592175 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b1ca8651-a1f7-4071-b51d-0fd9f62fab18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:55.592615 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b1ca8651-a1f7-4071-b51d-0fd9f62fab18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:55.741742 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b1ca8651-a1f7-4071-b51d-0fd9f62fab18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:39:55.751044 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b1ca8651-a1f7-4071-b51d-0fd9f62fab18 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1556 microversion: 2.1 time: 0.173034 Jun 30 16:39:55.753001 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 410/809] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:39:55 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:39:55.768380 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8805bf72-4287-4826-bebd-52a16a04db9b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:55.769026 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8805bf72-4287-4826-bebd-52a16a04db9b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:55.777105 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8805bf72-4287-4826-bebd-52a16a04db9b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:55.784496 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8805bf72-4287-4826-bebd-52a16a04db9b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:55.784496 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8805bf72-4287-4826-bebd-52a16a04db9b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:55.784496 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8805bf72-4287-4826-bebd-52a16a04db9b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:55.879055 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8805bf72-4287-4826-bebd-52a16a04db9b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114612 Jun 30 16:39:55.879683 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 400/810] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 30 16:39:55 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:39:57.016320 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-8832d5fe-7c63-4931-8fc5-9492dace2a00 req-15b4988a-7de4-450a-8397-314078ff4ee9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab43f806-fda4-432a-ac06-f950c83c9edf", "tag": "1b8b879d-fbe8-4d64-bc33-b23f193e7b6d"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:39:57.027676 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-8832d5fe-7c63-4931-8fc5-9492dace2a00 req-15b4988a-7de4-450a-8397-314078ff4ee9 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:57.031045 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-8832d5fe-7c63-4931-8fc5-9492dace2a00 req-15b4988a-7de4-450a-8397-314078ff4ee9 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:57.040164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-8832d5fe-7c63-4931-8fc5-9492dace2a00 req-15b4988a-7de4-450a-8397-314078ff4ee9 service nova] Creating event network-changed:1b8b879d-fbe8-4d64-bc33-b23f193e7b6d for instance ab43f806-fda4-432a-ac06-f950c83c9edf on hv-cinder-83602 Jun 30 16:39:57.045342 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-8832d5fe-7c63-4931-8fc5-9492dace2a00 req-15b4988a-7de4-450a-8397-314078ff4ee9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032839 Jun 30 16:39:57.048283 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 411/811] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:39:58.212507 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3ece06c3-5e6d-48bd-a152-2b39578da3ab tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:39:58.213358 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3ece06c3-5e6d-48bd-a152-2b39578da3ab tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:39:58.220110 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3ece06c3-5e6d-48bd-a152-2b39578da3ab tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:58.220711 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3ece06c3-5e6d-48bd-a152-2b39578da3ab tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:58.221538 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3ece06c3-5e6d-48bd-a152-2b39578da3ab tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:39:58.221978 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3ece06c3-5e6d-48bd-a152-2b39578da3ab tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:39:58.247519 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3ece06c3-5e6d-48bd-a152-2b39578da3ab tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958/ips" status: 200 len: 151 microversion: 2.20 time: 0.040100 Jun 30 16:39:58.248310 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 401/812] 10.222.0.67 () {60 vars in 1288 bytes} [Thu Jun 30 16:39:58 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:40:00.392675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-aa5d81c6-4158-4b4e-bde6-c98ad36af730 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:40:00.393304 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-aa5d81c6-4158-4b4e-bde6-c98ad36af730 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:00.395268 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:40:00.400941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-aa5d81c6-4158-4b4e-bde6-c98ad36af730 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:00.401523 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-aa5d81c6-4158-4b4e-bde6-c98ad36af730 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:00.402309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-aa5d81c6-4158-4b4e-bde6-c98ad36af730 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:00.402747 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-aa5d81c6-4158-4b4e-bde6-c98ad36af730 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:00.425739 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-aa5d81c6-4158-4b4e-bde6-c98ad36af730 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lazy-loading 'flavor' on Instance uuid 50e41d57-839c-4b6e-8215-d67d1d428958 {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:40:01.010542 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-aa5d81c6-4158-4b4e-bde6-c98ad36af730 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "POST /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958/action" status: 202 len: 0 microversion: 2.20 time: 0.622612 Jun 30 16:40:01.011525 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 412/813] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Jun 30 16:40:00 2022] POST /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:40:01.019645 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7fb6479d-632c-42ad-854e-93ebf41ce208 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:01.020263 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7fb6479d-632c-42ad-854e-93ebf41ce208 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:01.027104 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7fb6479d-632c-42ad-854e-93ebf41ce208 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:01.027598 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7fb6479d-632c-42ad-854e-93ebf41ce208 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:01.028435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7fb6479d-632c-42ad-854e-93ebf41ce208 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:01.028872 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7fb6479d-632c-42ad-854e-93ebf41ce208 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:01.170106 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7fb6479d-632c-42ad-854e-93ebf41ce208 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:01.178946 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7fb6479d-632c-42ad-854e-93ebf41ce208 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:01.181317 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7fb6479d-632c-42ad-854e-93ebf41ce208 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:01.182656 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7fb6479d-632c-42ad-854e-93ebf41ce208 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.167110 Jun 30 16:40:01.183219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 402/814] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:01 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:02.203498 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a8a4200f-3ca9-411f-9751-15ec56b5bf4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:02.204349 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a8a4200f-3ca9-411f-9751-15ec56b5bf4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:02.210943 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a8a4200f-3ca9-411f-9751-15ec56b5bf4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:02.211403 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a8a4200f-3ca9-411f-9751-15ec56b5bf4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:02.213476 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a8a4200f-3ca9-411f-9751-15ec56b5bf4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:02.213943 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a8a4200f-3ca9-411f-9751-15ec56b5bf4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:02.357665 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a8a4200f-3ca9-411f-9751-15ec56b5bf4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:02.366627 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a8a4200f-3ca9-411f-9751-15ec56b5bf4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:02.368752 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a8a4200f-3ca9-411f-9751-15ec56b5bf4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:02.370020 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a8a4200f-3ca9-411f-9751-15ec56b5bf4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.171419 Jun 30 16:40:02.370593 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 413/815] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:02 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:03.388528 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ad781fcd-ab90-4a02-82dc-361593eb8bc0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:03.389143 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ad781fcd-ab90-4a02-82dc-361593eb8bc0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:03.395877 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad781fcd-ab90-4a02-82dc-361593eb8bc0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:03.396335 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad781fcd-ab90-4a02-82dc-361593eb8bc0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:03.397115 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad781fcd-ab90-4a02-82dc-361593eb8bc0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:03.397552 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad781fcd-ab90-4a02-82dc-361593eb8bc0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:03.534349 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ad781fcd-ab90-4a02-82dc-361593eb8bc0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:03.544999 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ad781fcd-ab90-4a02-82dc-361593eb8bc0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:03.546488 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ad781fcd-ab90-4a02-82dc-361593eb8bc0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:03.547684 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ad781fcd-ab90-4a02-82dc-361593eb8bc0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.163254 Jun 30 16:40:03.548305 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 403/816] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:03 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:04.566554 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-03da244c-cbe1-478a-95e1-626c4f89e0fe tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:04.567270 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-03da244c-cbe1-478a-95e1-626c4f89e0fe tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:04.574510 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-03da244c-cbe1-478a-95e1-626c4f89e0fe tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:04.574969 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-03da244c-cbe1-478a-95e1-626c4f89e0fe tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:04.575781 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-03da244c-cbe1-478a-95e1-626c4f89e0fe tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:04.576220 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-03da244c-cbe1-478a-95e1-626c4f89e0fe tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:04.716169 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-03da244c-cbe1-478a-95e1-626c4f89e0fe tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:04.724444 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-03da244c-cbe1-478a-95e1-626c4f89e0fe tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:04.726016 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-03da244c-cbe1-478a-95e1-626c4f89e0fe tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:04.727183 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-03da244c-cbe1-478a-95e1-626c4f89e0fe tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.164630 Jun 30 16:40:04.727799 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 414/817] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:04 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:05.747036 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-98ef0585-010f-41f1-b051-b60ac56db411 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:05.747925 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-98ef0585-010f-41f1-b051-b60ac56db411 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:05.754896 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-98ef0585-010f-41f1-b051-b60ac56db411 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:05.755350 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-98ef0585-010f-41f1-b051-b60ac56db411 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:05.756172 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-98ef0585-010f-41f1-b051-b60ac56db411 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:05.756614 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-98ef0585-010f-41f1-b051-b60ac56db411 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:05.895683 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-98ef0585-010f-41f1-b051-b60ac56db411 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:05.904615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-98ef0585-010f-41f1-b051-b60ac56db411 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:05.906119 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-98ef0585-010f-41f1-b051-b60ac56db411 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:05.907300 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-98ef0585-010f-41f1-b051-b60ac56db411 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.164927 Jun 30 16:40:05.907884 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 404/818] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:05 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:06.927170 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-06ca561c-135c-4468-8900-9787447ddf93 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:06.927773 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-06ca561c-135c-4468-8900-9787447ddf93 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:06.935420 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-06ca561c-135c-4468-8900-9787447ddf93 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:06.940812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-06ca561c-135c-4468-8900-9787447ddf93 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:06.940812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-06ca561c-135c-4468-8900-9787447ddf93 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:06.940812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-06ca561c-135c-4468-8900-9787447ddf93 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:07.084514 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-06ca561c-135c-4468-8900-9787447ddf93 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:07.093030 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-06ca561c-135c-4468-8900-9787447ddf93 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:07.094541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-06ca561c-135c-4468-8900-9787447ddf93 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:07.095745 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-06ca561c-135c-4468-8900-9787447ddf93 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.172804 Jun 30 16:40:07.096307 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 415/819] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:06 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:08.118081 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-72d08166-e9f3-424f-a4c9-2abb86a5478c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:08.118698 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-72d08166-e9f3-424f-a4c9-2abb86a5478c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:08.125430 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-72d08166-e9f3-424f-a4c9-2abb86a5478c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:08.125878 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-72d08166-e9f3-424f-a4c9-2abb86a5478c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:08.126654 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-72d08166-e9f3-424f-a4c9-2abb86a5478c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:08.127092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-72d08166-e9f3-424f-a4c9-2abb86a5478c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:08.271240 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-72d08166-e9f3-424f-a4c9-2abb86a5478c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:08.280167 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-72d08166-e9f3-424f-a4c9-2abb86a5478c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:08.281767 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-72d08166-e9f3-424f-a4c9-2abb86a5478c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:08.282945 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-72d08166-e9f3-424f-a4c9-2abb86a5478c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.168789 Jun 30 16:40:08.283554 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 405/820] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:08 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:09.302069 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e4434a8d-edc0-49f8-9e2b-fe96cb763f7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:09.302632 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e4434a8d-edc0-49f8-9e2b-fe96cb763f7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:09.309269 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e4434a8d-edc0-49f8-9e2b-fe96cb763f7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:09.314607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e4434a8d-edc0-49f8-9e2b-fe96cb763f7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:09.314607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e4434a8d-edc0-49f8-9e2b-fe96cb763f7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:09.314607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e4434a8d-edc0-49f8-9e2b-fe96cb763f7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:09.314607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:40:09.453399 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e4434a8d-edc0-49f8-9e2b-fe96cb763f7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:09.461845 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e4434a8d-edc0-49f8-9e2b-fe96cb763f7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:09.463340 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e4434a8d-edc0-49f8-9e2b-fe96cb763f7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:09.465148 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e4434a8d-edc0-49f8-9e2b-fe96cb763f7e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.167238 Jun 30 16:40:09.465794 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 416/821] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:09 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:10.484768 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-cb3792e4-1025-4d0c-a82e-1c1ccf193052 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:10.485370 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-cb3792e4-1025-4d0c-a82e-1c1ccf193052 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:10.487851 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=50 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:40:10.492793 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cb3792e4-1025-4d0c-a82e-1c1ccf193052 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:10.493248 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cb3792e4-1025-4d0c-a82e-1c1ccf193052 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:10.494049 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cb3792e4-1025-4d0c-a82e-1c1ccf193052 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:10.494460 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cb3792e4-1025-4d0c-a82e-1c1ccf193052 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:10.633362 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-cb3792e4-1025-4d0c-a82e-1c1ccf193052 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:10.642692 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-cb3792e4-1025-4d0c-a82e-1c1ccf193052 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:10.645786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-cb3792e4-1025-4d0c-a82e-1c1ccf193052 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:10.645786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-cb3792e4-1025-4d0c-a82e-1c1ccf193052 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.166172 Jun 30 16:40:10.645986 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 406/822] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:10 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:11.663832 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a6cb6099-efd8-4865-a866-94af251937bb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:11.664494 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a6cb6099-efd8-4865-a866-94af251937bb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:11.672613 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a6cb6099-efd8-4865-a866-94af251937bb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:11.673152 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a6cb6099-efd8-4865-a866-94af251937bb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:11.673971 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a6cb6099-efd8-4865-a866-94af251937bb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:11.674415 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a6cb6099-efd8-4865-a866-94af251937bb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:11.810833 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a6cb6099-efd8-4865-a866-94af251937bb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:11.819457 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a6cb6099-efd8-4865-a866-94af251937bb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:11.820998 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a6cb6099-efd8-4865-a866-94af251937bb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:11.822172 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a6cb6099-efd8-4865-a866-94af251937bb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.162421 Jun 30 16:40:11.822759 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 417/823] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:11 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:12.840780 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e5c5b302-6957-4a97-ab25-297ef1ec2ea3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:12.841524 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e5c5b302-6957-4a97-ab25-297ef1ec2ea3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:12.848174 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e5c5b302-6957-4a97-ab25-297ef1ec2ea3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:12.848669 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e5c5b302-6957-4a97-ab25-297ef1ec2ea3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:12.849457 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e5c5b302-6957-4a97-ab25-297ef1ec2ea3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:12.849966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e5c5b302-6957-4a97-ab25-297ef1ec2ea3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:13.251532 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-e5c5b302-6957-4a97-ab25-297ef1ec2ea3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:13.259974 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-e5c5b302-6957-4a97-ab25-297ef1ec2ea3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:13.262770 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-e5c5b302-6957-4a97-ab25-297ef1ec2ea3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:13.263869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e5c5b302-6957-4a97-ab25-297ef1ec2ea3 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.426403 Jun 30 16:40:13.263869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 407/824] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:12 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:14.282872 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9605fb42-ab23-4a46-b69e-6ef67feed796 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:14.283460 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9605fb42-ab23-4a46-b69e-6ef67feed796 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:14.289775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9605fb42-ab23-4a46-b69e-6ef67feed796 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:14.290244 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9605fb42-ab23-4a46-b69e-6ef67feed796 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:14.291029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9605fb42-ab23-4a46-b69e-6ef67feed796 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:14.291597 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9605fb42-ab23-4a46-b69e-6ef67feed796 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:14.441936 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9605fb42-ab23-4a46-b69e-6ef67feed796 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:14.441936 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9605fb42-ab23-4a46-b69e-6ef67feed796 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:14.442315 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9605fb42-ab23-4a46-b69e-6ef67feed796 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:14.443463 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9605fb42-ab23-4a46-b69e-6ef67feed796 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.165678 Jun 30 16:40:14.444037 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 418/825] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:14 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:15.464434 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-71c683e1-7864-4939-97f5-42dd1c0a2bcb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:15.465069 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-71c683e1-7864-4939-97f5-42dd1c0a2bcb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:15.472994 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-71c683e1-7864-4939-97f5-42dd1c0a2bcb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:15.473440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-71c683e1-7864-4939-97f5-42dd1c0a2bcb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:15.474265 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-71c683e1-7864-4939-97f5-42dd1c0a2bcb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:15.474701 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-71c683e1-7864-4939-97f5-42dd1c0a2bcb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:15.617680 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-71c683e1-7864-4939-97f5-42dd1c0a2bcb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:15.628260 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-71c683e1-7864-4939-97f5-42dd1c0a2bcb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:15.629768 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-71c683e1-7864-4939-97f5-42dd1c0a2bcb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:15.630980 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-71c683e1-7864-4939-97f5-42dd1c0a2bcb tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.170470 Jun 30 16:40:15.631568 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 408/826] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:15 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:16.650495 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ac14251c-9e34-4512-864a-a1652484357e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:16.651105 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ac14251c-9e34-4512-864a-a1652484357e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:16.659210 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ac14251c-9e34-4512-864a-a1652484357e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:16.659696 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ac14251c-9e34-4512-864a-a1652484357e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:16.660466 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ac14251c-9e34-4512-864a-a1652484357e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:16.660903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ac14251c-9e34-4512-864a-a1652484357e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:16.801966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ac14251c-9e34-4512-864a-a1652484357e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:16.810043 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ac14251c-9e34-4512-864a-a1652484357e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:16.811689 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ac14251c-9e34-4512-864a-a1652484357e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:16.814236 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ac14251c-9e34-4512-864a-a1652484357e tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1744 microversion: 2.20 time: 0.167729 Jun 30 16:40:16.814880 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 419/827] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:16 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:17.833705 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3738b2ff-4a16-4de0-a700-0a86936bbc19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:17.834373 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3738b2ff-4a16-4de0-a700-0a86936bbc19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:17.841362 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3738b2ff-4a16-4de0-a700-0a86936bbc19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:17.841744 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3738b2ff-4a16-4de0-a700-0a86936bbc19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:17.842515 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3738b2ff-4a16-4de0-a700-0a86936bbc19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:17.842941 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3738b2ff-4a16-4de0-a700-0a86936bbc19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:17.983620 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3738b2ff-4a16-4de0-a700-0a86936bbc19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:17.991990 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3738b2ff-4a16-4de0-a700-0a86936bbc19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:17.993580 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3738b2ff-4a16-4de0-a700-0a86936bbc19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:17.994826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3738b2ff-4a16-4de0-a700-0a86936bbc19 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1744 microversion: 2.20 time: 0.165131 Jun 30 16:40:17.995387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 409/828] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:17 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:18.748360 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-57d724d4-ed94-480f-bf4d-e172944c267f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:40:18.748928 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-57d724d4-ed94-480f-bf4d-e172944c267f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:18.756028 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-57d724d4-ed94-480f-bf4d-e172944c267f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:18.756481 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-57d724d4-ed94-480f-bf4d-e172944c267f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:18.757304 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-57d724d4-ed94-480f-bf4d-e172944c267f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:18.757759 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-57d724d4-ed94-480f-bf4d-e172944c267f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:18.780299 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-57d724d4-ed94-480f-bf4d-e172944c267f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lazy-loading 'flavor' on Instance uuid 68d4ed30-dc39-4be8-b345-360410abdc13 {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:40:19.013601 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-b95fe079-b80f-4ac6-bfa4-24b52f5259a5 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:19.016699 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-b95fe079-b80f-4ac6-bfa4-24b52f5259a5 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:19.028744 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b95fe079-b80f-4ac6-bfa4-24b52f5259a5 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:19.029876 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b95fe079-b80f-4ac6-bfa4-24b52f5259a5 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:19.031976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b95fe079-b80f-4ac6-bfa4-24b52f5259a5 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:19.032829 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b95fe079-b80f-4ac6-bfa4-24b52f5259a5 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:19.140089 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-57d724d4-ed94-480f-bf4d-e172944c267f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "POST /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13/action" status: 202 len: 0 microversion: 2.1 time: 0.395598 Jun 30 16:40:19.141022 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 420/829] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 30 16:40:18 2022] POST /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13/action => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:40:19.147507 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-021d4d72-c6dc-4ce5-85fe-504dbc0dfff3 req-21b502b0-bf9e-4355-ac48-4cbb76b008bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e41d57-839c-4b6e-8215-d67d1d428958", "name": "network-vif-plugged", "status": "completed", "tag": "cef899ca-3465-4288-82e5-31385d9c468b"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:40:19.156546 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-021d4d72-c6dc-4ce5-85fe-504dbc0dfff3 req-21b502b0-bf9e-4355-ac48-4cbb76b008bd service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:19.157276 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-021d4d72-c6dc-4ce5-85fe-504dbc0dfff3 req-21b502b0-bf9e-4355-ac48-4cbb76b008bd service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:19.169403 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-021d4d72-c6dc-4ce5-85fe-504dbc0dfff3 req-21b502b0-bf9e-4355-ac48-4cbb76b008bd service nova] Creating event network-vif-plugged:cef899ca-3465-4288-82e5-31385d9c468b for instance 50e41d57-839c-4b6e-8215-d67d1d428958 on hv-cinder-83602 Jun 30 16:40:19.175608 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-021d4d72-c6dc-4ce5-85fe-504dbc0dfff3 req-21b502b0-bf9e-4355-ac48-4cbb76b008bd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032816 Jun 30 16:40:19.176602 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 421/830] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:40:19.183049 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f56756cc-ad2c-4ff7-bd71-199568536c0b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:19.183751 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f56756cc-ad2c-4ff7-bd71-199568536c0b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:19.192356 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f56756cc-ad2c-4ff7-bd71-199568536c0b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:19.193066 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f56756cc-ad2c-4ff7-bd71-199568536c0b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:19.195645 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f56756cc-ad2c-4ff7-bd71-199568536c0b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:19.196317 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f56756cc-ad2c-4ff7-bd71-199568536c0b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:19.222854 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b95fe079-b80f-4ac6-bfa4-24b52f5259a5 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:19.232316 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b95fe079-b80f-4ac6-bfa4-24b52f5259a5 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:19.234767 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b95fe079-b80f-4ac6-bfa4-24b52f5259a5 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:19.236728 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-b95fe079-b80f-4ac6-bfa4-24b52f5259a5 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1744 microversion: 2.20 time: 0.226876 Jun 30 16:40:19.248161 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 410/831] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:19 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1744 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:40:19.366745 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f56756cc-ad2c-4ff7-bd71-199568536c0b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:19.375782 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f56756cc-ad2c-4ff7-bd71-199568536c0b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1569 microversion: 2.1 time: 0.197083 Jun 30 16:40:19.376691 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 422/832] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:19 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:20.254855 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-98761f9c-2660-43f3-b47e-80a6349cb1ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:20.256260 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-98761f9c-2660-43f3-b47e-80a6349cb1ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:20.264953 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-98761f9c-2660-43f3-b47e-80a6349cb1ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:20.264953 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-98761f9c-2660-43f3-b47e-80a6349cb1ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:20.264953 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-98761f9c-2660-43f3-b47e-80a6349cb1ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:20.265340 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-98761f9c-2660-43f3-b47e-80a6349cb1ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:20.395026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0ccb305b-76f9-45de-8607-b3ebff04b9d7 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:20.399290 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-0ccb305b-76f9-45de-8607-b3ebff04b9d7 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:20.403722 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0ccb305b-76f9-45de-8607-b3ebff04b9d7 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:20.404318 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0ccb305b-76f9-45de-8607-b3ebff04b9d7 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:20.405489 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0ccb305b-76f9-45de-8607-b3ebff04b9d7 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:20.406138 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0ccb305b-76f9-45de-8607-b3ebff04b9d7 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:20.441234 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-98761f9c-2660-43f3-b47e-80a6349cb1ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:20.457217 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-98761f9c-2660-43f3-b47e-80a6349cb1ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:20.458836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-98761f9c-2660-43f3-b47e-80a6349cb1ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:20.460075 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-98761f9c-2660-43f3-b47e-80a6349cb1ed tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1739 microversion: 2.20 time: 0.209686 Jun 30 16:40:20.473992 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 411/833] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:20 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:20.564759 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-0ccb305b-76f9-45de-8607-b3ebff04b9d7 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:20.573470 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-0ccb305b-76f9-45de-8607-b3ebff04b9d7 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1569 microversion: 2.1 time: 0.183164 Jun 30 16:40:20.574058 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 423/834] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:20 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:40:21.480971 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f2df7928-1306-499e-ac9e-a12f55ef3c8f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:21.481608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f2df7928-1306-499e-ac9e-a12f55ef3c8f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:21.490440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f2df7928-1306-499e-ac9e-a12f55ef3c8f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:21.490895 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f2df7928-1306-499e-ac9e-a12f55ef3c8f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:21.491702 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f2df7928-1306-499e-ac9e-a12f55ef3c8f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:21.492168 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f2df7928-1306-499e-ac9e-a12f55ef3c8f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:21.597747 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b373c285-0cdc-4f39-a815-c7cde291bce1 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:21.597747 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b373c285-0cdc-4f39-a815-c7cde291bce1 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:21.611298 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b373c285-0cdc-4f39-a815-c7cde291bce1 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:21.611814 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b373c285-0cdc-4f39-a815-c7cde291bce1 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:21.613388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b373c285-0cdc-4f39-a815-c7cde291bce1 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:21.613569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b373c285-0cdc-4f39-a815-c7cde291bce1 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:21.707575 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f2df7928-1306-499e-ac9e-a12f55ef3c8f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:21.719171 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f2df7928-1306-499e-ac9e-a12f55ef3c8f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:21.720944 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f2df7928-1306-499e-ac9e-a12f55ef3c8f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:21.723452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f2df7928-1306-499e-ac9e-a12f55ef3c8f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1739 microversion: 2.20 time: 0.246277 Jun 30 16:40:21.734839 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 412/835] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:21 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:21.816950 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b373c285-0cdc-4f39-a815-c7cde291bce1 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:21.826925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b373c285-0cdc-4f39-a815-c7cde291bce1 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1569 microversion: 2.1 time: 0.238746 Jun 30 16:40:21.828118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 424/836] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:21 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:22.743356 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-342ab435-d788-47fb-8c46-e608e3d2b23c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:22.744123 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-342ab435-d788-47fb-8c46-e608e3d2b23c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:22.751541 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-342ab435-d788-47fb-8c46-e608e3d2b23c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:22.752104 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-342ab435-d788-47fb-8c46-e608e3d2b23c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:22.753582 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-342ab435-d788-47fb-8c46-e608e3d2b23c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:22.754133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-342ab435-d788-47fb-8c46-e608e3d2b23c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:22.845802 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-802cc264-0c4b-4e49-b195-c8aceb5a6ecf tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:22.846449 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-802cc264-0c4b-4e49-b195-c8aceb5a6ecf tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:22.854520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-802cc264-0c4b-4e49-b195-c8aceb5a6ecf tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:22.855079 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-802cc264-0c4b-4e49-b195-c8aceb5a6ecf tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:22.860455 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-802cc264-0c4b-4e49-b195-c8aceb5a6ecf tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:22.860919 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-802cc264-0c4b-4e49-b195-c8aceb5a6ecf tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:22.918769 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-342ab435-d788-47fb-8c46-e608e3d2b23c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:22.928473 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-342ab435-d788-47fb-8c46-e608e3d2b23c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:22.930029 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-342ab435-d788-47fb-8c46-e608e3d2b23c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:22.931196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-342ab435-d788-47fb-8c46-e608e3d2b23c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1739 microversion: 2.20 time: 0.191994 Jun 30 16:40:22.931794 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 413/837] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:22 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:23.018536 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-802cc264-0c4b-4e49-b195-c8aceb5a6ecf tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:23.027519 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-802cc264-0c4b-4e49-b195-c8aceb5a6ecf tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1569 microversion: 2.1 time: 0.186210 Jun 30 16:40:23.028108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 425/838] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:22 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:40:23.951227 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-96160835-0806-4c6a-a8dd-f3051be5eddf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:23.951941 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-96160835-0806-4c6a-a8dd-f3051be5eddf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:23.959330 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-96160835-0806-4c6a-a8dd-f3051be5eddf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:23.959878 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-96160835-0806-4c6a-a8dd-f3051be5eddf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:23.960720 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-96160835-0806-4c6a-a8dd-f3051be5eddf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:23.961221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-96160835-0806-4c6a-a8dd-f3051be5eddf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:24.045634 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-545118c4-2869-48aa-95fd-598325061fa0 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:24.046206 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-545118c4-2869-48aa-95fd-598325061fa0 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:24.065541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-545118c4-2869-48aa-95fd-598325061fa0 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:24.072413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-545118c4-2869-48aa-95fd-598325061fa0 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:24.074728 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-545118c4-2869-48aa-95fd-598325061fa0 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:24.075664 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-545118c4-2869-48aa-95fd-598325061fa0 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:24.182935 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-96160835-0806-4c6a-a8dd-f3051be5eddf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:24.195363 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-96160835-0806-4c6a-a8dd-f3051be5eddf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:24.197260 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-96160835-0806-4c6a-a8dd-f3051be5eddf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:24.198501 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-96160835-0806-4c6a-a8dd-f3051be5eddf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1739 microversion: 2.20 time: 0.252159 Jun 30 16:40:24.199706 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 414/839] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:23 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:24.281947 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-545118c4-2869-48aa-95fd-598325061fa0 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:24.292642 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-545118c4-2869-48aa-95fd-598325061fa0 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1569 microversion: 2.1 time: 0.250504 Jun 30 16:40:24.305509 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 426/840] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:24 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1569 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:25.216850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c3b29785-f066-45a7-a6b1-6930087c2b12 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:25.217460 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c3b29785-f066-45a7-a6b1-6930087c2b12 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:25.225473 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c3b29785-f066-45a7-a6b1-6930087c2b12 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:25.226219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c3b29785-f066-45a7-a6b1-6930087c2b12 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:25.227005 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c3b29785-f066-45a7-a6b1-6930087c2b12 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:25.227445 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c3b29785-f066-45a7-a6b1-6930087c2b12 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:25.313602 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-947d835f-117b-4ab4-83bf-29f460104c04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:25.314351 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-947d835f-117b-4ab4-83bf-29f460104c04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:25.326603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-947d835f-117b-4ab4-83bf-29f460104c04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:25.328135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-947d835f-117b-4ab4-83bf-29f460104c04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:25.329165 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-947d835f-117b-4ab4-83bf-29f460104c04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:25.330012 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-947d835f-117b-4ab4-83bf-29f460104c04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:25.467786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c3b29785-f066-45a7-a6b1-6930087c2b12 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:25.493031 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c3b29785-f066-45a7-a6b1-6930087c2b12 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:25.505021 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c3b29785-f066-45a7-a6b1-6930087c2b12 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:25.506340 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c3b29785-f066-45a7-a6b1-6930087c2b12 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1739 microversion: 2.20 time: 0.293316 Jun 30 16:40:25.507254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 415/841] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:25 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:25.578260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-947d835f-117b-4ab4-83bf-29f460104c04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:25.587227 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-947d835f-117b-4ab4-83bf-29f460104c04 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1569 microversion: 2.1 time: 0.279356 Jun 30 16:40:25.588740 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 427/842] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:25 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1569 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:26.526210 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-b5018675-5e24-43bb-865c-96fd33a374bf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:26.526794 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-b5018675-5e24-43bb-865c-96fd33a374bf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:26.533617 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b5018675-5e24-43bb-865c-96fd33a374bf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:26.535049 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b5018675-5e24-43bb-865c-96fd33a374bf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:26.535568 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b5018675-5e24-43bb-865c-96fd33a374bf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:26.536065 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-b5018675-5e24-43bb-865c-96fd33a374bf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:26.538760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=96 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:40:26.605643 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f4524616-e55f-4dd0-a003-1e0a1ecde5d6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:26.606731 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f4524616-e55f-4dd0-a003-1e0a1ecde5d6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:26.614109 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f4524616-e55f-4dd0-a003-1e0a1ecde5d6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:26.614968 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f4524616-e55f-4dd0-a003-1e0a1ecde5d6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:26.615827 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f4524616-e55f-4dd0-a003-1e0a1ecde5d6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:26.616291 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f4524616-e55f-4dd0-a003-1e0a1ecde5d6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:26.706705 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b5018675-5e24-43bb-865c-96fd33a374bf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:26.714669 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b5018675-5e24-43bb-865c-96fd33a374bf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:26.716284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-b5018675-5e24-43bb-865c-96fd33a374bf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:26.717547 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-b5018675-5e24-43bb-865c-96fd33a374bf tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1739 microversion: 2.20 time: 0.195797 Jun 30 16:40:26.718121 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 416/843] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:26 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:26.774908 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f4524616-e55f-4dd0-a003-1e0a1ecde5d6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:26.782967 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f4524616-e55f-4dd0-a003-1e0a1ecde5d6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1569 microversion: 2.1 time: 0.181148 Jun 30 16:40:26.783505 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 428/844] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:26 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:27.873652 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ad7611fb-427d-4540-8078-9a575e91b959 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:27.874395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-de121c5b-816b-4f04-b364-65c59e4abb29 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:27.874803 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ad7611fb-427d-4540-8078-9a575e91b959 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:27.874909 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-de121c5b-816b-4f04-b364-65c59e4abb29 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:27.882781 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-de121c5b-816b-4f04-b364-65c59e4abb29 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:27.884094 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-de121c5b-816b-4f04-b364-65c59e4abb29 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:27.884946 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad7611fb-427d-4540-8078-9a575e91b959 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:27.885415 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad7611fb-427d-4540-8078-9a575e91b959 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:27.885885 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-de121c5b-816b-4f04-b364-65c59e4abb29 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:27.886252 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad7611fb-427d-4540-8078-9a575e91b959 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:27.886697 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad7611fb-427d-4540-8078-9a575e91b959 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:27.886960 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-de121c5b-816b-4f04-b364-65c59e4abb29 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:28.122831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-de121c5b-816b-4f04-b364-65c59e4abb29 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:28.123865 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ad7611fb-427d-4540-8078-9a575e91b959 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:28.134720 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ad7611fb-427d-4540-8078-9a575e91b959 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1569 microversion: 2.1 time: 0.264800 Jun 30 16:40:28.142710 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-de121c5b-816b-4f04-b364-65c59e4abb29 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:28.145081 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-de121c5b-816b-4f04-b364-65c59e4abb29 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:28.146263 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-de121c5b-816b-4f04-b364-65c59e4abb29 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1739 microversion: 2.20 time: 0.276525 Jun 30 16:40:28.158254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 429/845] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:27 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:28.158593 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 417/846] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:27 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1569 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:29.167941 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8d90cc2f-9a94-4bdc-9438-bbfb127dc673 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:29.169276 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8d90cc2f-9a94-4bdc-9438-bbfb127dc673 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:29.170234 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-23341dcc-48a2-4085-bc24-bd1d2fd42302 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:29.170903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-23341dcc-48a2-4085-bc24-bd1d2fd42302 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:29.178400 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d90cc2f-9a94-4bdc-9438-bbfb127dc673 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:29.178856 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d90cc2f-9a94-4bdc-9438-bbfb127dc673 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:29.179280 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-23341dcc-48a2-4085-bc24-bd1d2fd42302 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:29.179680 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d90cc2f-9a94-4bdc-9438-bbfb127dc673 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:29.179983 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-23341dcc-48a2-4085-bc24-bd1d2fd42302 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:29.180586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d90cc2f-9a94-4bdc-9438-bbfb127dc673 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:29.180838 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-23341dcc-48a2-4085-bc24-bd1d2fd42302 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:29.181348 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-23341dcc-48a2-4085-bc24-bd1d2fd42302 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:29.430121 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-23341dcc-48a2-4085-bc24-bd1d2fd42302 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:29.431787 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8d90cc2f-9a94-4bdc-9438-bbfb127dc673 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:29.445138 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8d90cc2f-9a94-4bdc-9438-bbfb127dc673 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:29.450107 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8d90cc2f-9a94-4bdc-9438-bbfb127dc673 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:29.451301 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8d90cc2f-9a94-4bdc-9438-bbfb127dc673 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1739 microversion: 2.20 time: 0.287618 Jun 30 16:40:29.451917 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 418/847] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:29 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1739 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:40:29.462707 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-23341dcc-48a2-4085-bc24-bd1d2fd42302 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1569 microversion: 2.1 time: 0.285787 Jun 30 16:40:29.463405 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 430/848] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:29 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1569 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:29.806991 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-38498e2e-bb31-4a65-af38-1482c3be2b19 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:29.809258 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-38498e2e-bb31-4a65-af38-1482c3be2b19 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:29.815697 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-38498e2e-bb31-4a65-af38-1482c3be2b19 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:29.815697 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-38498e2e-bb31-4a65-af38-1482c3be2b19 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:29.816710 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-38498e2e-bb31-4a65-af38-1482c3be2b19 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:29.817160 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-38498e2e-bb31-4a65-af38-1482c3be2b19 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:29.834480 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:40:29.846193 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-38498e2e-bb31-4a65-af38-1482c3be2b19 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/ips" status: 200 len: 144 microversion: 2.1 time: 0.043239 Jun 30 16:40:29.848080 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 431/849] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 30 16:40:29 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/ips => generated 144 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:40:30.470578 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-041981e9-612f-4d9f-991d-5aa4a248df4a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:30.473530 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-041981e9-612f-4d9f-991d-5aa4a248df4a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:30.480620 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-041981e9-612f-4d9f-991d-5aa4a248df4a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:30.481321 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-041981e9-612f-4d9f-991d-5aa4a248df4a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:30.481777 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-5faac2ac-43d4-4b67-83fb-304cee61f67b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:30.482516 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-5faac2ac-43d4-4b67-83fb-304cee61f67b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:30.482957 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-041981e9-612f-4d9f-991d-5aa4a248df4a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:30.483627 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-041981e9-612f-4d9f-991d-5aa4a248df4a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:30.499565 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5faac2ac-43d4-4b67-83fb-304cee61f67b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:30.501459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5faac2ac-43d4-4b67-83fb-304cee61f67b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:30.504799 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5faac2ac-43d4-4b67-83fb-304cee61f67b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:30.505811 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5faac2ac-43d4-4b67-83fb-304cee61f67b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:30.729596 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-041981e9-612f-4d9f-991d-5aa4a248df4a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:30.743290 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-041981e9-612f-4d9f-991d-5aa4a248df4a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:30.745361 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-041981e9-612f-4d9f-991d-5aa4a248df4a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:30.754311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-041981e9-612f-4d9f-991d-5aa4a248df4a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1739 microversion: 2.20 time: 0.286357 Jun 30 16:40:30.765902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 419/850] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:30 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:40:30.803750 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5faac2ac-43d4-4b67-83fb-304cee61f67b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:30.814627 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-5faac2ac-43d4-4b67-83fb-304cee61f67b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1569 microversion: 2.1 time: 0.337266 Jun 30 16:40:30.826448 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 432/851] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:30 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1569 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:40:31.670992 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-259269b5-9b36-4c07-bf85-26c712376404 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8afeb482-1371-4e3d-81c9-f7091a4d4ba2"}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:40:31.672138 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-259269b5-9b36-4c07-bf85-26c712376404 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:31.679123 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-259269b5-9b36-4c07-bf85-26c712376404 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:31.679604 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-259269b5-9b36-4c07-bf85-26c712376404 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:31.680404 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-259269b5-9b36-4c07-bf85-26c712376404 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:31.680843 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-259269b5-9b36-4c07-bf85-26c712376404 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:31.776373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1736a7b6-82bd-4f4b-a9d3-8ef621ba85c7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:31.778810 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1736a7b6-82bd-4f4b-a9d3-8ef621ba85c7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:31.779992 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=42 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:40:31.786695 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1736a7b6-82bd-4f4b-a9d3-8ef621ba85c7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:31.788210 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1736a7b6-82bd-4f4b-a9d3-8ef621ba85c7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:31.789120 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1736a7b6-82bd-4f4b-a9d3-8ef621ba85c7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:31.789744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1736a7b6-82bd-4f4b-a9d3-8ef621ba85c7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:31.953805 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1736a7b6-82bd-4f4b-a9d3-8ef621ba85c7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:31.962413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1736a7b6-82bd-4f4b-a9d3-8ef621ba85c7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:31.963909 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1736a7b6-82bd-4f4b-a9d3-8ef621ba85c7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:31.965049 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1736a7b6-82bd-4f4b-a9d3-8ef621ba85c7 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1739 microversion: 2.20 time: 0.196447 Jun 30 16:40:31.965598 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 433/852] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:31 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:40:31.970007 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-59134d78-07c1-4154-afa4-9b220bccfd8a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:31.970604 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-59134d78-07c1-4154-afa4-9b220bccfd8a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:31.977156 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-59134d78-07c1-4154-afa4-9b220bccfd8a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:31.977493 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-59134d78-07c1-4154-afa4-9b220bccfd8a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:31.978258 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-59134d78-07c1-4154-afa4-9b220bccfd8a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:31.978689 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-59134d78-07c1-4154-afa4-9b220bccfd8a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:32.123251 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-59134d78-07c1-4154-afa4-9b220bccfd8a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:32.130984 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-59134d78-07c1-4154-afa4-9b220bccfd8a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1569 microversion: 2.1 time: 0.164440 Jun 30 16:40:32.131625 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 434/853] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:31 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:32.642710 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-259269b5-9b36-4c07-bf85-26c712376404 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "POST /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.975012 Jun 30 16:40:32.645070 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 420/854] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 30 16:40:31 2022] POST /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments => generated 194 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:40:32.983898 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ecf104fa-3748-4434-ae8d-4249f07f5064 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:32.984497 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ecf104fa-3748-4434-ae8d-4249f07f5064 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:32.992457 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ecf104fa-3748-4434-ae8d-4249f07f5064 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:32.992988 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ecf104fa-3748-4434-ae8d-4249f07f5064 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:32.994269 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ecf104fa-3748-4434-ae8d-4249f07f5064 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:32.995065 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ecf104fa-3748-4434-ae8d-4249f07f5064 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:33.139161 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ecf104fa-3748-4434-ae8d-4249f07f5064 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:33.148388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ecf104fa-3748-4434-ae8d-4249f07f5064 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:33.149679 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6038179d-89a2-4065-8576-dd5db5f99fdc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:33.150189 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ecf104fa-3748-4434-ae8d-4249f07f5064 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:33.150378 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6038179d-89a2-4065-8576-dd5db5f99fdc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:33.151049 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ecf104fa-3748-4434-ae8d-4249f07f5064 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1721 microversion: 2.20 time: 0.171713 Jun 30 16:40:33.151641 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 435/855] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:32 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:33.157315 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6038179d-89a2-4065-8576-dd5db5f99fdc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:33.157791 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6038179d-89a2-4065-8576-dd5db5f99fdc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:33.158566 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6038179d-89a2-4065-8576-dd5db5f99fdc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:33.159068 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6038179d-89a2-4065-8576-dd5db5f99fdc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:33.300852 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6038179d-89a2-4065-8576-dd5db5f99fdc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:33.308948 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6038179d-89a2-4065-8576-dd5db5f99fdc tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1570 microversion: 2.1 time: 0.163396 Jun 30 16:40:33.309528 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 421/856] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:33 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:33.326620 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8c26e2c5-0d0d-43d5-8b00-da69de33103e tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:40:33.327423 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8c26e2c5-0d0d-43d5-8b00-da69de33103e tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:33.334140 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8c26e2c5-0d0d-43d5-8b00-da69de33103e tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:33.334597 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8c26e2c5-0d0d-43d5-8b00-da69de33103e tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:33.335404 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8c26e2c5-0d0d-43d5-8b00-da69de33103e tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:33.335991 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8c26e2c5-0d0d-43d5-8b00-da69de33103e tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:33.762978 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8c26e2c5-0d0d-43d5-8b00-da69de33103e tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "POST /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13/action" status: 202 len: 0 microversion: 2.1 time: 0.436526 Jun 30 16:40:33.763847 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 436/857] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 30 16:40:33 2022] POST /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:40:33.769741 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7c8f05a6-e1f3-411f-bfbe-cf59da740e25 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:33.770345 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7c8f05a6-e1f3-411f-bfbe-cf59da740e25 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:33.779297 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7c8f05a6-e1f3-411f-bfbe-cf59da740e25 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:33.780360 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7c8f05a6-e1f3-411f-bfbe-cf59da740e25 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:33.781171 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7c8f05a6-e1f3-411f-bfbe-cf59da740e25 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:33.781614 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7c8f05a6-e1f3-411f-bfbe-cf59da740e25 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:33.926242 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7c8f05a6-e1f3-411f-bfbe-cf59da740e25 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:33.934147 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7c8f05a6-e1f3-411f-bfbe-cf59da740e25 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1578 microversion: 2.1 time: 0.169758 Jun 30 16:40:33.934921 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 422/858] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:33 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:34.170892 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8755a1e4-98c1-4cc2-a0e8-41cbd6013d8b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:34.171463 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8755a1e4-98c1-4cc2-a0e8-41cbd6013d8b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:34.177712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8755a1e4-98c1-4cc2-a0e8-41cbd6013d8b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:34.178228 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8755a1e4-98c1-4cc2-a0e8-41cbd6013d8b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:34.179002 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8755a1e4-98c1-4cc2-a0e8-41cbd6013d8b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:34.179438 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8755a1e4-98c1-4cc2-a0e8-41cbd6013d8b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:34.319648 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8755a1e4-98c1-4cc2-a0e8-41cbd6013d8b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:34.327874 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8755a1e4-98c1-4cc2-a0e8-41cbd6013d8b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:34.329394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8755a1e4-98c1-4cc2-a0e8-41cbd6013d8b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:34.330560 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8755a1e4-98c1-4cc2-a0e8-41cbd6013d8b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1721 microversion: 2.20 time: 0.164418 Jun 30 16:40:34.331816 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 437/859] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:34 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:34.954212 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8787014a-9286-4c60-b1c1-9ff1d41d165b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:34.957185 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8787014a-9286-4c60-b1c1-9ff1d41d165b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:34.969793 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8787014a-9286-4c60-b1c1-9ff1d41d165b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:34.970250 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8787014a-9286-4c60-b1c1-9ff1d41d165b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:34.971034 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8787014a-9286-4c60-b1c1-9ff1d41d165b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:34.971696 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8787014a-9286-4c60-b1c1-9ff1d41d165b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:35.072964 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-4915b420-94bb-4fa6-b641-554a9125ddcb req-1b9aea79-6028-48e3-98de-cd8b23eb6411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d4ed30-dc39-4be8-b345-360410abdc13", "name": "network-vif-unplugged", "status": "completed", "tag": "ab01136b-ddb4-42c0-b8a6-880714395a42"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:40:35.087478 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-4915b420-94bb-4fa6-b641-554a9125ddcb req-1b9aea79-6028-48e3-98de-cd8b23eb6411 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:35.087995 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-4915b420-94bb-4fa6-b641-554a9125ddcb req-1b9aea79-6028-48e3-98de-cd8b23eb6411 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:35.099962 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.compute.server_external_events [req-4915b420-94bb-4fa6-b641-554a9125ddcb req-1b9aea79-6028-48e3-98de-cd8b23eb6411 service nova] Unable to find a host for instance 68d4ed30-dc39-4be8-b345-360410abdc13. Dropping event network-vif-unplugged {{(pid=124815) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 16:40:35.100809 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-4915b420-94bb-4fa6-b641-554a9125ddcb req-1b9aea79-6028-48e3-98de-cd8b23eb6411 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032130 Jun 30 16:40:35.101376 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 438/860] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 30 16:40:35.137049 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8787014a-9286-4c60-b1c1-9ff1d41d165b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:35.146504 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8787014a-9286-4c60-b1c1-9ff1d41d165b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1518 microversion: 2.1 time: 0.197440 Jun 30 16:40:35.147277 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 423/861] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:34 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:40:35.351148 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-57e67e41-287a-49de-9f23-c67efb5c429a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:35.352323 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-57e67e41-287a-49de-9f23-c67efb5c429a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:35.360689 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-57e67e41-287a-49de-9f23-c67efb5c429a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:35.361279 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-57e67e41-287a-49de-9f23-c67efb5c429a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:35.362138 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-57e67e41-287a-49de-9f23-c67efb5c429a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:35.363320 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-57e67e41-287a-49de-9f23-c67efb5c429a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:35.513634 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-57e67e41-287a-49de-9f23-c67efb5c429a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:35.523151 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-57e67e41-287a-49de-9f23-c67efb5c429a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:35.524712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-57e67e41-287a-49de-9f23-c67efb5c429a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:35.525985 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-57e67e41-287a-49de-9f23-c67efb5c429a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1724 microversion: 2.20 time: 0.180187 Jun 30 16:40:35.526527 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 439/862] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:35 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:35.548127 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3c90be2d-09f8-4ee5-ba8b-5c48615da503 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec8e4827-9f78-4c65-9e46-9c59cfcc5183"}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:40:35.549453 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3c90be2d-09f8-4ee5-ba8b-5c48615da503 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:35.556222 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3c90be2d-09f8-4ee5-ba8b-5c48615da503 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:35.556680 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3c90be2d-09f8-4ee5-ba8b-5c48615da503 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:35.557452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3c90be2d-09f8-4ee5-ba8b-5c48615da503 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:35.557935 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3c90be2d-09f8-4ee5-ba8b-5c48615da503 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:36.164780 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-82e0a4e2-7562-460d-bfeb-06635c8dc802 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:36.165759 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-82e0a4e2-7562-460d-bfeb-06635c8dc802 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:36.171308 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-82e0a4e2-7562-460d-bfeb-06635c8dc802 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:36.171925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-82e0a4e2-7562-460d-bfeb-06635c8dc802 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:36.172705 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-82e0a4e2-7562-460d-bfeb-06635c8dc802 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:36.173219 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-82e0a4e2-7562-460d-bfeb-06635c8dc802 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:36.329555 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-82e0a4e2-7562-460d-bfeb-06635c8dc802 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:36.337248 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-82e0a4e2-7562-460d-bfeb-06635c8dc802 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1520 microversion: 2.1 time: 0.176895 Jun 30 16:40:36.343037 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 440/863] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:36 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:40:36.648279 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3c90be2d-09f8-4ee5-ba8b-5c48615da503 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "POST /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.104120 Jun 30 16:40:36.648906 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 424/864] 10.222.0.67 () {62 vars in 1363 bytes} [Thu Jun 30 16:40:35 2022] POST /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958/os-volume_attachments => generated 188 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 30 16:40:36.774331 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-26ead4b1-4cc2-4792-8136-8ed0b36f8c20 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:36.774828 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-26ead4b1-4cc2-4792-8136-8ed0b36f8c20 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:36.781386 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-26ead4b1-4cc2-4792-8136-8ed0b36f8c20 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:36.781865 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-26ead4b1-4cc2-4792-8136-8ed0b36f8c20 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:36.782630 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-26ead4b1-4cc2-4792-8136-8ed0b36f8c20 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:36.783109 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-26ead4b1-4cc2-4792-8136-8ed0b36f8c20 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:37.116958 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-74c45738-5f40-4842-9bea-a73c1dc58b6a req-9ce15f6c-6715-48ed-acc5-c3cdf31209a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e41d57-839c-4b6e-8215-d67d1d428958", "name": "network-vif-unplugged", "status": "completed", "tag": "cef899ca-3465-4288-82e5-31385d9c468b"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:40:37.126393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-74c45738-5f40-4842-9bea-a73c1dc58b6a req-9ce15f6c-6715-48ed-acc5-c3cdf31209a6 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:37.126852 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-74c45738-5f40-4842-9bea-a73c1dc58b6a req-9ce15f6c-6715-48ed-acc5-c3cdf31209a6 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:37.138708 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.compute.server_external_events [req-74c45738-5f40-4842-9bea-a73c1dc58b6a req-9ce15f6c-6715-48ed-acc5-c3cdf31209a6 service nova] Unable to find a host for instance 50e41d57-839c-4b6e-8215-d67d1d428958. Dropping event network-vif-unplugged {{(pid=124814) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 30 16:40:37.139636 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-74c45738-5f40-4842-9bea-a73c1dc58b6a req-9ce15f6c-6715-48ed-acc5-c3cdf31209a6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027936 Jun 30 16:40:37.140218 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 425/865] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 30 16:40:37.355057 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-982df063-260e-4fae-ba31-9858a2fe3762 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:37.355701 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-982df063-260e-4fae-ba31-9858a2fe3762 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:37.361842 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-982df063-260e-4fae-ba31-9858a2fe3762 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:37.362327 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-982df063-260e-4fae-ba31-9858a2fe3762 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:37.363066 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-982df063-260e-4fae-ba31-9858a2fe3762 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:37.363523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-982df063-260e-4fae-ba31-9858a2fe3762 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:37.482806 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-26ead4b1-4cc2-4792-8136-8ed0b36f8c20 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "DELETE /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958/os-volume_attachments/ec8e4827-9f78-4c65-9e46-9c59cfcc5183" status: 202 len: 0 microversion: 2.20 time: 0.712388 Jun 30 16:40:37.483551 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 441/866] 10.222.0.67 () {60 vars in 1456 bytes} [Thu Jun 30 16:40:36 2022] DELETE /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958/os-volume_attachments/ec8e4827-9f78-4c65-9e46-9c59cfcc5183 => generated 0 bytes in 715 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 30 16:40:37.497710 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-982df063-260e-4fae-ba31-9858a2fe3762 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:37.505854 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-982df063-260e-4fae-ba31-9858a2fe3762 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1520 microversion: 2.1 time: 0.155536 Jun 30 16:40:37.506427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 426/867] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:37 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:40:37.541405 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-55bb6a67-c858-4871-bd7a-9471b2b46f99 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:40:37.541976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-55bb6a67-c858-4871-bd7a-9471b2b46f99 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:37.548052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-55bb6a67-c858-4871-bd7a-9471b2b46f99 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:37.548501 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-55bb6a67-c858-4871-bd7a-9471b2b46f99 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:37.549323 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-55bb6a67-c858-4871-bd7a-9471b2b46f99 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:37.549850 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-55bb6a67-c858-4871-bd7a-9471b2b46f99 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:37.805568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-55bb6a67-c858-4871-bd7a-9471b2b46f99 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "POST /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958/action" status: 202 len: 0 microversion: 2.20 time: 0.267827 Jun 30 16:40:37.806325 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 442/868] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Jun 30 16:40:37 2022] POST /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:40:37.814478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d5c1a0fb-630f-442c-933c-3e7dd132f3da tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:37.815092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d5c1a0fb-630f-442c-933c-3e7dd132f3da tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:37.821757 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d5c1a0fb-630f-442c-933c-3e7dd132f3da tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:37.822208 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d5c1a0fb-630f-442c-933c-3e7dd132f3da tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:37.822975 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d5c1a0fb-630f-442c-933c-3e7dd132f3da tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:37.823414 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d5c1a0fb-630f-442c-933c-3e7dd132f3da tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:37.959629 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d5c1a0fb-630f-442c-933c-3e7dd132f3da tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:37.968009 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d5c1a0fb-630f-442c-933c-3e7dd132f3da tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:37.969572 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d5c1a0fb-630f-442c-933c-3e7dd132f3da tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:37.970742 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d5c1a0fb-630f-442c-933c-3e7dd132f3da tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1672 microversion: 2.20 time: 0.160446 Jun 30 16:40:37.971309 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 427/869] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:37 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:38.523139 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0dde0b35-731b-48d6-ad92-67169565deca tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:38.523829 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-0dde0b35-731b-48d6-ad92-67169565deca tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:38.530275 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0dde0b35-731b-48d6-ad92-67169565deca tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:38.530731 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0dde0b35-731b-48d6-ad92-67169565deca tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:38.531598 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0dde0b35-731b-48d6-ad92-67169565deca tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:38.532045 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0dde0b35-731b-48d6-ad92-67169565deca tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:38.705536 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-0dde0b35-731b-48d6-ad92-67169565deca tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:38.714529 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-0dde0b35-731b-48d6-ad92-67169565deca tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1520 microversion: 2.1 time: 0.195894 Jun 30 16:40:38.715192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 443/870] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:38 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:38.989471 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f32db2de-a967-45b2-ae89-caf6ee4acaca tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:38.990083 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f32db2de-a967-45b2-ae89-caf6ee4acaca tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:39.008853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f32db2de-a967-45b2-ae89-caf6ee4acaca tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:39.011403 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f32db2de-a967-45b2-ae89-caf6ee4acaca tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:39.011403 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f32db2de-a967-45b2-ae89-caf6ee4acaca tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:39.011403 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f32db2de-a967-45b2-ae89-caf6ee4acaca tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:39.149261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f32db2de-a967-45b2-ae89-caf6ee4acaca tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:39.157267 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f32db2de-a967-45b2-ae89-caf6ee4acaca tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:39.158768 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f32db2de-a967-45b2-ae89-caf6ee4acaca tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:39.159982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f32db2de-a967-45b2-ae89-caf6ee4acaca tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1672 microversion: 2.20 time: 0.174617 Jun 30 16:40:39.160542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 428/871] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:38 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:39.739702 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ae162aeb-b1e8-409d-9b05-c07ab0a11c52 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:39.740314 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ae162aeb-b1e8-409d-9b05-c07ab0a11c52 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:39.747148 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ae162aeb-b1e8-409d-9b05-c07ab0a11c52 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:39.747649 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ae162aeb-b1e8-409d-9b05-c07ab0a11c52 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:39.748459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ae162aeb-b1e8-409d-9b05-c07ab0a11c52 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:39.748898 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ae162aeb-b1e8-409d-9b05-c07ab0a11c52 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:39.768167 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:40:39.898263 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ae162aeb-b1e8-409d-9b05-c07ab0a11c52 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:39.906113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ae162aeb-b1e8-409d-9b05-c07ab0a11c52 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1520 microversion: 2.1 time: 0.170947 Jun 30 16:40:39.906680 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 444/872] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:39 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:40.178309 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-fb572d44-20da-45fc-94f1-f497b0aab39a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:40.179214 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-fb572d44-20da-45fc-94f1-f497b0aab39a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:40.185989 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fb572d44-20da-45fc-94f1-f497b0aab39a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:40.187618 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fb572d44-20da-45fc-94f1-f497b0aab39a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:40.187618 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fb572d44-20da-45fc-94f1-f497b0aab39a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:40.187845 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fb572d44-20da-45fc-94f1-f497b0aab39a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:40.208373 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:40:40.344014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-fb572d44-20da-45fc-94f1-f497b0aab39a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:40.353954 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-fb572d44-20da-45fc-94f1-f497b0aab39a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:40.356069 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-fb572d44-20da-45fc-94f1-f497b0aab39a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:40.357536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-fb572d44-20da-45fc-94f1-f497b0aab39a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1674 microversion: 2.20 time: 0.183301 Jun 30 16:40:40.365656 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 429/873] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:40 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1674 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:40.903188 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-bcb51faf-77bb-45fc-bee4-8810159be07a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:40.903870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-bcb51faf-77bb-45fc-bee4-8810159be07a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:40.911393 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bcb51faf-77bb-45fc-bee4-8810159be07a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:40.911869 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bcb51faf-77bb-45fc-bee4-8810159be07a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:40.912763 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bcb51faf-77bb-45fc-bee4-8810159be07a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:40.913204 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bcb51faf-77bb-45fc-bee4-8810159be07a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:40.926661 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-279ebb4b-5850-407a-82bd-80bb08f9d283 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:40.927840 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-279ebb4b-5850-407a-82bd-80bb08f9d283 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:40.934777 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=48 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:40:40.936921 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-279ebb4b-5850-407a-82bd-80bb08f9d283 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:40.937811 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-279ebb4b-5850-407a-82bd-80bb08f9d283 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:40.939100 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-279ebb4b-5850-407a-82bd-80bb08f9d283 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:40.940069 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-279ebb4b-5850-407a-82bd-80bb08f9d283 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:40.947807 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-bcb51faf-77bb-45fc-bee4-8810159be07a tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/ips" status: 200 len: 149 microversion: 2.1 time: 0.048442 Jun 30 16:40:40.948395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 445/874] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 30 16:40:40 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:40:41.097389 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-279ebb4b-5850-407a-82bd-80bb08f9d283 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:41.106089 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-279ebb4b-5850-407a-82bd-80bb08f9d283 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1520 microversion: 2.1 time: 0.185482 Jun 30 16:40:41.106978 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 430/875] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:40 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:41.377413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-788ab756-387c-4241-b0b1-eb0a7e34cc54 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:41.378587 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-788ab756-387c-4241-b0b1-eb0a7e34cc54 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:41.385212 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-788ab756-387c-4241-b0b1-eb0a7e34cc54 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:41.385670 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-788ab756-387c-4241-b0b1-eb0a7e34cc54 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:41.386458 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-788ab756-387c-4241-b0b1-eb0a7e34cc54 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:41.386903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-788ab756-387c-4241-b0b1-eb0a7e34cc54 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:41.539122 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-788ab756-387c-4241-b0b1-eb0a7e34cc54 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:41.548478 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-788ab756-387c-4241-b0b1-eb0a7e34cc54 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:41.550918 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-788ab756-387c-4241-b0b1-eb0a7e34cc54 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:41.551948 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-788ab756-387c-4241-b0b1-eb0a7e34cc54 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1730 microversion: 2.20 time: 0.179060 Jun 30 16:40:41.552500 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 446/876] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:41 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:41.828493 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3b8eee9b-589a-427a-8481-1b2ede1997cc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:41.829593 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3b8eee9b-589a-427a-8481-1b2ede1997cc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:41.837120 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3b8eee9b-589a-427a-8481-1b2ede1997cc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:41.837564 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3b8eee9b-589a-427a-8481-1b2ede1997cc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:41.838519 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3b8eee9b-589a-427a-8481-1b2ede1997cc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:41.839150 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3b8eee9b-589a-427a-8481-1b2ede1997cc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:41.877516 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3b8eee9b-589a-427a-8481-1b2ede1997cc tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054150 Jun 30 16:40:41.878308 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 431/877] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:40:41 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:40:41.893203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7b0e14ce-d2b8-445f-8b72-622cdb34b4f3 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:41.893938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-7b0e14ce-d2b8-445f-8b72-622cdb34b4f3 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:41.900957 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7b0e14ce-d2b8-445f-8b72-622cdb34b4f3 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:41.901678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7b0e14ce-d2b8-445f-8b72-622cdb34b4f3 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:41.902463 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7b0e14ce-d2b8-445f-8b72-622cdb34b4f3 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:41.903591 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7b0e14ce-d2b8-445f-8b72-622cdb34b4f3 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:41.937697 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7b0e14ce-d2b8-445f-8b72-622cdb34b4f3 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments/8afeb482-1371-4e3d-81c9-f7091a4d4ba2" status: 200 len: 194 microversion: 2.1 time: 0.052619 Jun 30 16:40:41.939147 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 447/878] 10.222.0.67 () {58 vars in 1412 bytes} [Thu Jun 30 16:40:41 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments/8afeb482-1371-4e3d-81c9-f7091a4d4ba2 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:40:42.125617 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2b7277f4-c25a-4293-bbc2-f7d29879a921 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:42.125935 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2b7277f4-c25a-4293-bbc2-f7d29879a921 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:42.132693 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2b7277f4-c25a-4293-bbc2-f7d29879a921 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:42.133243 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2b7277f4-c25a-4293-bbc2-f7d29879a921 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:42.134106 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2b7277f4-c25a-4293-bbc2-f7d29879a921 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:42.134616 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2b7277f4-c25a-4293-bbc2-f7d29879a921 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:42.306354 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2b7277f4-c25a-4293-bbc2-f7d29879a921 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:42.319383 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2b7277f4-c25a-4293-bbc2-f7d29879a921 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1520 microversion: 2.1 time: 0.198438 Jun 30 16:40:42.323933 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 432/879] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:42 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:42.572376 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-304cc14f-dc24-4ffe-a925-a0f86d594625 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:42.573955 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-304cc14f-dc24-4ffe-a925-a0f86d594625 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:42.582182 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-304cc14f-dc24-4ffe-a925-a0f86d594625 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:42.582821 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-304cc14f-dc24-4ffe-a925-a0f86d594625 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:42.583624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-304cc14f-dc24-4ffe-a925-a0f86d594625 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:42.584059 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-304cc14f-dc24-4ffe-a925-a0f86d594625 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:42.743650 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-304cc14f-dc24-4ffe-a925-a0f86d594625 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:42.753257 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-304cc14f-dc24-4ffe-a925-a0f86d594625 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:42.754867 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-304cc14f-dc24-4ffe-a925-a0f86d594625 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:42.756078 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-304cc14f-dc24-4ffe-a925-a0f86d594625 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1730 microversion: 2.20 time: 0.188918 Jun 30 16:40:42.767293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 448/880] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:42 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1730 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:42.795976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2de7d7ec-713f-4082-9035-f1a7caa32944 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "291d3cdc-a5ce-4f89-9c2b-715a998e8602"}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:40:42.795976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2de7d7ec-713f-4082-9035-f1a7caa32944 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:42.795976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2de7d7ec-713f-4082-9035-f1a7caa32944 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:42.795976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2de7d7ec-713f-4082-9035-f1a7caa32944 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:42.796480 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2de7d7ec-713f-4082-9035-f1a7caa32944 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:42.796480 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2de7d7ec-713f-4082-9035-f1a7caa32944 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:43.338759 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2d3cd7d4-87a8-4ad7-ac01-d5bb68bb1223 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:43.339375 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2d3cd7d4-87a8-4ad7-ac01-d5bb68bb1223 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:43.346388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2d3cd7d4-87a8-4ad7-ac01-d5bb68bb1223 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:43.347338 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2d3cd7d4-87a8-4ad7-ac01-d5bb68bb1223 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:43.348161 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2d3cd7d4-87a8-4ad7-ac01-d5bb68bb1223 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:43.348604 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2d3cd7d4-87a8-4ad7-ac01-d5bb68bb1223 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:43.530838 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2d3cd7d4-87a8-4ad7-ac01-d5bb68bb1223 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:43.542278 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2d3cd7d4-87a8-4ad7-ac01-d5bb68bb1223 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1576 microversion: 2.1 time: 0.207713 Jun 30 16:40:43.543533 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 449/881] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:43 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:40:43.775610 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-763bc700-e4af-45c9-9391-5e3d81541ea6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:43.776571 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-763bc700-e4af-45c9-9391-5e3d81541ea6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:43.783385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-763bc700-e4af-45c9-9391-5e3d81541ea6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:43.783385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-763bc700-e4af-45c9-9391-5e3d81541ea6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:43.788280 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-763bc700-e4af-45c9-9391-5e3d81541ea6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:43.788745 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-763bc700-e4af-45c9-9391-5e3d81541ea6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:43.965150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-763bc700-e4af-45c9-9391-5e3d81541ea6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:43.977383 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-763bc700-e4af-45c9-9391-5e3d81541ea6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:43.979530 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-763bc700-e4af-45c9-9391-5e3d81541ea6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:43.981677 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-763bc700-e4af-45c9-9391-5e3d81541ea6 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1730 microversion: 2.20 time: 0.210441 Jun 30 16:40:43.998237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 450/882] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:43 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:44.005112 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-73111737-4329-4c51-a15f-4549c783b628 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4371250a-8795-4b3f-a86f-7519f6cb0cb0"}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:40:44.006532 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-73111737-4329-4c51-a15f-4549c783b628 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:44.013607 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-73111737-4329-4c51-a15f-4549c783b628 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:44.018440 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-73111737-4329-4c51-a15f-4549c783b628 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:44.020319 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-73111737-4329-4c51-a15f-4549c783b628 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:44.020938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-73111737-4329-4c51-a15f-4549c783b628 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:52.310718 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-73111737-4329-4c51-a15f-4549c783b628 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "POST /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.310923 Jun 30 16:40:52.312903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 451/883] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 30 16:40:43 2022] POST /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments => generated 194 bytes in 8312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:40:52.318170 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-62d7711b-ba35-4a02-adb4-54710972f5f6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:52.318659 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-62d7711b-ba35-4a02-adb4-54710972f5f6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:52.325110 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-62d7711b-ba35-4a02-adb4-54710972f5f6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:52.325559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-62d7711b-ba35-4a02-adb4-54710972f5f6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:52.326326 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-62d7711b-ba35-4a02-adb4-54710972f5f6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:52.326763 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-62d7711b-ba35-4a02-adb4-54710972f5f6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:52.356130 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2de7d7ec-713f-4082-9035-f1a7caa32944 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "POST /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.577525 Jun 30 16:40:52.358764 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 433/884] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 30 16:40:42 2022] POST /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments => generated 194 bytes in 9579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:40:52.362208 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-63bb05a8-74a2-4deb-aa05-4a27a742db4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:52.363719 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-63bb05a8-74a2-4deb-aa05-4a27a742db4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:52.371895 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-63bb05a8-74a2-4deb-aa05-4a27a742db4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:52.372347 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-63bb05a8-74a2-4deb-aa05-4a27a742db4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:52.373135 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-63bb05a8-74a2-4deb-aa05-4a27a742db4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:52.373574 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-63bb05a8-74a2-4deb-aa05-4a27a742db4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:52.562993 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-62d7711b-ba35-4a02-adb4-54710972f5f6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:52.575360 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-62d7711b-ba35-4a02-adb4-54710972f5f6 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1576 microversion: 2.1 time: 0.262381 Jun 30 16:40:52.576583 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 452/885] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:52 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1576 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:52.585312 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-69035079-b1a9-4dc8-9e66-1f4c68fcf95e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:52.585825 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-69035079-b1a9-4dc8-9e66-1f4c68fcf95e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:52.586728 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-63bb05a8-74a2-4deb-aa05-4a27a742db4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:52.595080 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-69035079-b1a9-4dc8-9e66-1f4c68fcf95e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:52.595856 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-69035079-b1a9-4dc8-9e66-1f4c68fcf95e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:52.597714 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-69035079-b1a9-4dc8-9e66-1f4c68fcf95e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:52.598010 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-63bb05a8-74a2-4deb-aa05-4a27a742db4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:52.598269 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-69035079-b1a9-4dc8-9e66-1f4c68fcf95e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:52.600027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-63bb05a8-74a2-4deb-aa05-4a27a742db4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:52.602003 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-63bb05a8-74a2-4deb-aa05-4a27a742db4b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1730 microversion: 2.20 time: 0.243967 Jun 30 16:40:52.622446 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 434/886] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:52 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1730 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:52.628660 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-69035079-b1a9-4dc8-9e66-1f4c68fcf95e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Going to try to terminate instance {{(pid=124815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:40:52.980610 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-69035079-b1a9-4dc8-9e66-1f4c68fcf95e tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 204 len: 0 microversion: 2.1 time: 0.402526 Jun 30 16:40:52.981418 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 453/887] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:40:52 2022] DELETE /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:40:52.991927 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1995804d-a9cb-4a4d-828a-49d6782ea014 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:52.992541 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-1995804d-a9cb-4a4d-828a-49d6782ea014 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:52.999452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1995804d-a9cb-4a4d-828a-49d6782ea014 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:53.000363 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1995804d-a9cb-4a4d-828a-49d6782ea014 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:53.000761 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1995804d-a9cb-4a4d-828a-49d6782ea014 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:53.001190 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1995804d-a9cb-4a4d-828a-49d6782ea014 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:53.149697 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-1995804d-a9cb-4a4d-828a-49d6782ea014 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:53.158537 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-1995804d-a9cb-4a4d-828a-49d6782ea014 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1577 microversion: 2.1 time: 0.172891 Jun 30 16:40:53.160059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 435/888] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:52 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:53.594423 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-177b3d27-c0a1-4d2c-a936-58f694fb64e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:53.595160 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-177b3d27-c0a1-4d2c-a936-58f694fb64e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:53.601951 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-177b3d27-c0a1-4d2c-a936-58f694fb64e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:53.603092 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-177b3d27-c0a1-4d2c-a936-58f694fb64e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:53.604921 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-177b3d27-c0a1-4d2c-a936-58f694fb64e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:53.605453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-177b3d27-c0a1-4d2c-a936-58f694fb64e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:53.621633 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-44048f40-6a8f-43ef-b861-02819125c2ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:53.622240 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-44048f40-6a8f-43ef-b861-02819125c2ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:53.629305 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-44048f40-6a8f-43ef-b861-02819125c2ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:53.630003 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-44048f40-6a8f-43ef-b861-02819125c2ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:53.630992 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-44048f40-6a8f-43ef-b861-02819125c2ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:53.631441 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-44048f40-6a8f-43ef-b861-02819125c2ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:53.821595 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-177b3d27-c0a1-4d2c-a936-58f694fb64e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:53.829181 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-44048f40-6a8f-43ef-b861-02819125c2ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:53.829902 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-177b3d27-c0a1-4d2c-a936-58f694fb64e9 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1576 microversion: 2.1 time: 0.239515 Jun 30 16:40:53.830563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 454/889] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:53 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:53.837760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-44048f40-6a8f-43ef-b861-02819125c2ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:53.839249 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-44048f40-6a8f-43ef-b861-02819125c2ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:53.840465 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-44048f40-6a8f-43ef-b861-02819125c2ac tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1730 microversion: 2.20 time: 0.222946 Jun 30 16:40:53.841011 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 436/890] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:53 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:54.176898 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f0988200-3883-465d-92c5-e8dcd6d641db tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:54.177512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f0988200-3883-465d-92c5-e8dcd6d641db tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:54.183748 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f0988200-3883-465d-92c5-e8dcd6d641db tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:54.184207 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f0988200-3883-465d-92c5-e8dcd6d641db tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:54.185039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f0988200-3883-465d-92c5-e8dcd6d641db tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:54.185486 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f0988200-3883-465d-92c5-e8dcd6d641db tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:54.322957 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f0988200-3883-465d-92c5-e8dcd6d641db tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:54.330622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f0988200-3883-465d-92c5-e8dcd6d641db tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1577 microversion: 2.1 time: 0.157747 Jun 30 16:40:54.331686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 455/891] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:54 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:54.848095 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a2d060eb-a03b-42e7-8bcb-6abf94375bcb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:54.851264 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a2d060eb-a03b-42e7-8bcb-6abf94375bcb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:54.855209 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a2d060eb-a03b-42e7-8bcb-6abf94375bcb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:54.855697 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a2d060eb-a03b-42e7-8bcb-6abf94375bcb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:54.856470 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a2d060eb-a03b-42e7-8bcb-6abf94375bcb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:54.856902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a2d060eb-a03b-42e7-8bcb-6abf94375bcb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:54.865313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d6c23f06-bf22-4334-879d-c5d1b62bc6be tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:54.865978 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d6c23f06-bf22-4334-879d-c5d1b62bc6be tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:54.874339 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d6c23f06-bf22-4334-879d-c5d1b62bc6be tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:54.874798 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d6c23f06-bf22-4334-879d-c5d1b62bc6be tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:54.875742 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d6c23f06-bf22-4334-879d-c5d1b62bc6be tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:54.876188 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d6c23f06-bf22-4334-879d-c5d1b62bc6be tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:55.083769 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a2d060eb-a03b-42e7-8bcb-6abf94375bcb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:55.087667 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d6c23f06-bf22-4334-879d-c5d1b62bc6be tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:55.096273 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d6c23f06-bf22-4334-879d-c5d1b62bc6be tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:55.098171 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d6c23f06-bf22-4334-879d-c5d1b62bc6be tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:55.099311 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d6c23f06-bf22-4334-879d-c5d1b62bc6be tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1730 microversion: 2.20 time: 0.238589 Jun 30 16:40:55.099903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 456/892] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:54 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1730 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:40:55.112435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a2d060eb-a03b-42e7-8bcb-6abf94375bcb tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1576 microversion: 2.1 time: 0.268736 Jun 30 16:40:55.113880 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 437/893] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:54 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1576 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:55.256309 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-12bbe8ff-a0cd-4492-93ac-1cafccdb7478 req-3b067cee-b444-452c-b118-1b83f3acfbff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e41d57-839c-4b6e-8215-d67d1d428958", "name": "network-vif-plugged", "status": "completed", "tag": "cef899ca-3465-4288-82e5-31385d9c468b"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:40:55.264637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-12bbe8ff-a0cd-4492-93ac-1cafccdb7478 req-3b067cee-b444-452c-b118-1b83f3acfbff service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:55.265090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-12bbe8ff-a0cd-4492-93ac-1cafccdb7478 req-3b067cee-b444-452c-b118-1b83f3acfbff service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:55.277194 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-12bbe8ff-a0cd-4492-93ac-1cafccdb7478 req-3b067cee-b444-452c-b118-1b83f3acfbff service nova] Creating event network-vif-plugged:cef899ca-3465-4288-82e5-31385d9c468b for instance 50e41d57-839c-4b6e-8215-d67d1d428958 on hv-cinder-83602 Jun 30 16:40:55.282314 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-12bbe8ff-a0cd-4492-93ac-1cafccdb7478 req-3b067cee-b444-452c-b118-1b83f3acfbff service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032028 Jun 30 16:40:55.283287 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 457/894] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:40:55.350247 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9e4b119d-6fd2-4292-8477-fc147fbd51a7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:55.351175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9e4b119d-6fd2-4292-8477-fc147fbd51a7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:55.357763 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9e4b119d-6fd2-4292-8477-fc147fbd51a7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:55.358223 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9e4b119d-6fd2-4292-8477-fc147fbd51a7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:55.359074 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9e4b119d-6fd2-4292-8477-fc147fbd51a7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:55.359541 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9e4b119d-6fd2-4292-8477-fc147fbd51a7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:55.441896 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9e4b119d-6fd2-4292-8477-fc147fbd51a7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:55.448844 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9e4b119d-6fd2-4292-8477-fc147fbd51a7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1509 microversion: 2.1 time: 0.103497 Jun 30 16:40:55.449972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 438/895] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:55 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1509 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:55.933888 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-c711475f-2dcf-480e-a891-a1b817d04214 req-0b07de49-b61a-4e51-8332-4239908732a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8cb685e-c960-41dc-89ad-bc5cabc56565", "name": "network-vif-deleted", "tag": "2cf2d7d3-c6a6-4edb-8d6d-b8575a6abf8c"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:40:55.951223 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-c711475f-2dcf-480e-a891-a1b817d04214 req-0b07de49-b61a-4e51-8332-4239908732a7 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:55.952703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-c711475f-2dcf-480e-a891-a1b817d04214 req-0b07de49-b61a-4e51-8332-4239908732a7 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:55.966098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-c711475f-2dcf-480e-a891-a1b817d04214 req-0b07de49-b61a-4e51-8332-4239908732a7 service nova] Creating event network-vif-deleted:2cf2d7d3-c6a6-4edb-8d6d-b8575a6abf8c for instance d8cb685e-c960-41dc-89ad-bc5cabc56565 on hv-cinder-83602 Jun 30 16:40:55.971930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-c711475f-2dcf-480e-a891-a1b817d04214 req-0b07de49-b61a-4e51-8332-4239908732a7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042520 Jun 30 16:40:55.973448 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 458/896] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:40:56.122116 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8e12ef33-96c7-4fbc-8e59-07fd625a60e0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:56.123261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8e12ef33-96c7-4fbc-8e59-07fd625a60e0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:56.132148 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4a908efc-da9a-4f9a-a238-5d3ad6fbe9bd tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:56.133190 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4a908efc-da9a-4f9a-a238-5d3ad6fbe9bd tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:56.133800 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8e12ef33-96c7-4fbc-8e59-07fd625a60e0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:56.134545 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8e12ef33-96c7-4fbc-8e59-07fd625a60e0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:56.135604 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8e12ef33-96c7-4fbc-8e59-07fd625a60e0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:56.136167 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8e12ef33-96c7-4fbc-8e59-07fd625a60e0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:56.140128 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4a908efc-da9a-4f9a-a238-5d3ad6fbe9bd tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:56.140566 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4a908efc-da9a-4f9a-a238-5d3ad6fbe9bd tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:56.141543 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4a908efc-da9a-4f9a-a238-5d3ad6fbe9bd tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:56.142188 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4a908efc-da9a-4f9a-a238-5d3ad6fbe9bd tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:56.364446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-4a908efc-da9a-4f9a-a238-5d3ad6fbe9bd tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:56.368103 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8e12ef33-96c7-4fbc-8e59-07fd625a60e0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:56.371059 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:40:56.375603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-4a908efc-da9a-4f9a-a238-5d3ad6fbe9bd tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1576 microversion: 2.1 time: 0.249051 Jun 30 16:40:56.378781 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 459/897] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:56 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1576 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:56.378954 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8e12ef33-96c7-4fbc-8e59-07fd625a60e0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:56.378954 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8e12ef33-96c7-4fbc-8e59-07fd625a60e0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:56.380236 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8e12ef33-96c7-4fbc-8e59-07fd625a60e0 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1730 microversion: 2.20 time: 0.265790 Jun 30 16:40:56.380786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 439/898] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:56 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1730 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:56.469288 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-28c61c0f-1fb5-4fa0-b5ed-8167b3f33ca4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:56.470064 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-28c61c0f-1fb5-4fa0-b5ed-8167b3f33ca4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:56.477375 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-28c61c0f-1fb5-4fa0-b5ed-8167b3f33ca4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:56.477836 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-28c61c0f-1fb5-4fa0-b5ed-8167b3f33ca4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:56.478629 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-28c61c0f-1fb5-4fa0-b5ed-8167b3f33ca4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:56.479075 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-28c61c0f-1fb5-4fa0-b5ed-8167b3f33ca4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:56.545890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-28c61c0f-1fb5-4fa0-b5ed-8167b3f33ca4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:56.552344 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-28c61c0f-1fb5-4fa0-b5ed-8167b3f33ca4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1226 microversion: 2.1 time: 0.089278 Jun 30 16:40:56.552927 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 460/899] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:56 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:57.400301 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ca3065d4-3c5e-4c42-9416-63adce70f148 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:57.401172 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8b17998f-3fbf-4c8b-ada6-4b406fc52d7b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:57.402013 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ca3065d4-3c5e-4c42-9416-63adce70f148 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:57.402198 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8b17998f-3fbf-4c8b-ada6-4b406fc52d7b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:57.409278 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8b17998f-3fbf-4c8b-ada6-4b406fc52d7b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:57.411121 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8b17998f-3fbf-4c8b-ada6-4b406fc52d7b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:57.412526 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8b17998f-3fbf-4c8b-ada6-4b406fc52d7b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:57.412683 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ca3065d4-3c5e-4c42-9416-63adce70f148 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:57.412900 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8b17998f-3fbf-4c8b-ada6-4b406fc52d7b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:57.413383 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ca3065d4-3c5e-4c42-9416-63adce70f148 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:57.414502 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ca3065d4-3c5e-4c42-9416-63adce70f148 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:57.415201 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ca3065d4-3c5e-4c42-9416-63adce70f148 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:57.642404 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ca3065d4-3c5e-4c42-9416-63adce70f148 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:57.647383 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8b17998f-3fbf-4c8b-ada6-4b406fc52d7b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:57.651521 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ca3065d4-3c5e-4c42-9416-63adce70f148 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1576 microversion: 2.1 time: 0.257615 Jun 30 16:40:57.658198 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8b17998f-3fbf-4c8b-ada6-4b406fc52d7b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:57.661307 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8b17998f-3fbf-4c8b-ada6-4b406fc52d7b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:57.662677 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 440/900] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:57 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:57.663233 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8b17998f-3fbf-4c8b-ada6-4b406fc52d7b tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1730 microversion: 2.20 time: 0.267111 Jun 30 16:40:57.663949 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 461/901] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:57 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1730 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:40:57.668500 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-73a685f2-7953-4018-b650-6052a338017c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:57.669327 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-73a685f2-7953-4018-b650-6052a338017c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:57.687072 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-73a685f2-7953-4018-b650-6052a338017c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:57.687072 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-73a685f2-7953-4018-b650-6052a338017c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:57.687072 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-73a685f2-7953-4018-b650-6052a338017c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:57.687072 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-73a685f2-7953-4018-b650-6052a338017c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:57.742576 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-73a685f2-7953-4018-b650-6052a338017c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:57.743104 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-73a685f2-7953-4018-b650-6052a338017c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:57.743628 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-73a685f2-7953-4018-b650-6052a338017c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lazy-loading 'fault' on Instance uuid d8cb685e-c960-41dc-89ad-bc5cabc56565 {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:40:57.785169 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-73a685f2-7953-4018-b650-6052a338017c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:57.795730 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-73a685f2-7953-4018-b650-6052a338017c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 200 len: 1231 microversion: 2.1 time: 0.131087 Jun 30 16:40:57.796546 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 441/902] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:57 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 1231 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:58.670134 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-5d67b028-57c6-425f-ae82-11af15f77973 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:58.670746 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-5d67b028-57c6-425f-ae82-11af15f77973 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:58.678962 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5d67b028-57c6-425f-ae82-11af15f77973 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:58.679426 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5d67b028-57c6-425f-ae82-11af15f77973 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:58.680442 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5d67b028-57c6-425f-ae82-11af15f77973 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:58.680898 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5d67b028-57c6-425f-ae82-11af15f77973 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:58.682604 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d8b15d7c-f219-4a0e-b632-551979990487 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:58.683219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d8b15d7c-f219-4a0e-b632-551979990487 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:58.692636 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d8b15d7c-f219-4a0e-b632-551979990487 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:58.693183 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d8b15d7c-f219-4a0e-b632-551979990487 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:58.694051 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d8b15d7c-f219-4a0e-b632-551979990487 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:58.694575 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d8b15d7c-f219-4a0e-b632-551979990487 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:58.895351 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5d67b028-57c6-425f-ae82-11af15f77973 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:58.898210 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d8b15d7c-f219-4a0e-b632-551979990487 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:58.917831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-5d67b028-57c6-425f-ae82-11af15f77973 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1576 microversion: 2.1 time: 0.237910 Jun 30 16:40:58.917831 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 462/903] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:58 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:40:58.918078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d8b15d7c-f219-4a0e-b632-551979990487 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:58.918078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d8b15d7c-f219-4a0e-b632-551979990487 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:40:58.918078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d8b15d7c-f219-4a0e-b632-551979990487 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1730 microversion: 2.20 time: 0.230828 Jun 30 16:40:58.918435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e525e865-d6dc-4446-b128-dc80bc98aafd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:58.918435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e525e865-d6dc-4446-b128-dc80bc98aafd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:58.918615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 442/904] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:40:58 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:40:58.918706 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e525e865-d6dc-4446-b128-dc80bc98aafd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:58.918706 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e525e865-d6dc-4446-b128-dc80bc98aafd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:58.918706 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e525e865-d6dc-4446-b128-dc80bc98aafd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:58.918706 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e525e865-d6dc-4446-b128-dc80bc98aafd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:58.933731 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-e525e865-d6dc-4446-b128-dc80bc98aafd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] HTTP exception thrown: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e525e865-d6dc-4446-b128-dc80bc98aafd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Request method failure captured: Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 HTTP/1.1 Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdFKSuL379510th7MRHxDO2Bx_XY-IYFkeUTjH0H_tMoqAwI_akvpTpYg9ei9xNz-CijIvdzVYPO4UIA3C8V3MsHSgkp7qfVdqGtxGOrN9LXxp2opb4DIxUhnRLOET4Lf0Nyj-8JkJlXhXr7Ua8wFhAMUVBTRMh5bddde8tbhNOLlMg Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: 99847b649bfd4ca6a33cb2ea97ad0469 Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:40:58.935678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:40:58.937394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/99847b649bfd4ca6a33cb2ea97ad0469"}]}] Jun 30 16:40:58.937394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:40:58.937394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: 99847b649bfd4ca6a33cb2ea97ad0469 Jun 30 16:40:58.937394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:40:58.937394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-TestVolumeBootPattern-1904314065-project Jun 30 16:40:58.937394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:40:58.937394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:40:58.937394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: bb8a8a4e8b634322a92992379c98b721 Jun 30 16:40:58.937394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-TestVolumeBootPattern-1904314065-project Jun 30 16:40:58.937394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:40:58.937394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:40:58.937394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'd8cb685e-c960-41dc-89ad-bc5cabc56565'} Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:40:58.938293 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:40:58.940117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:40:58.942633 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e525e865-d6dc-4446-b128-dc80bc98aafd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Returning 404 to user: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:40:58.942633 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e525e865-d6dc-4446-b128-dc80bc98aafd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 404 len: 111 microversion: 2.1 time: 0.031532 Jun 30 16:40:58.942633 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 463/905] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:58 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:40:59.048191 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-684455967", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1686313724", "security_groups": [{"name": "tempest-secgroup-smoke-1280353264"}], "block_device_mapping_v2": [{"uuid": "551e139d-64ea-4eb2-831e-5f335698de98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "65fa0cba-7cff-4856-97c9-e4f078bde7b0"}]}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:40:59.172025 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.network.neutron [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] validate_networks() for [('65fa0cba-7cff-4856-97c9-e4f078bde7b0', None, None, None, None, None)] {{(pid=124814) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:40:59.570701 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Flavor limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:40:59.571131 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Image limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:40:59.571647 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Flavor pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:40:59.572065 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Image pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:40:59.572483 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:40:59.585069 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:59.585522 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:59.586335 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:59.586774 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:59.604762 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Getting quotas for project 99847b649bfd4ca6a33cb2ea97ad0469. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:40:59.608799 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Getting quotas for user bb8a8a4e8b634322a92992379c98b721 and project 99847b649bfd4ca6a33cb2ea97ad0469. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:40:59.670174 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Going to run 1 instances... {{(pid=124814) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:40:59.672350 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='551e139d-64ea-4eb2-831e-5f335698de98',volume_size=None,volume_type=None)] {{(pid=124814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:40:59.921535 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-bf173084-f7aa-425b-9d36-a3b1e89c6835 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:40:59.922145 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-bf173084-f7aa-425b-9d36-a3b1e89c6835 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:40:59.929495 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bf173084-f7aa-425b-9d36-a3b1e89c6835 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:59.929957 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bf173084-f7aa-425b-9d36-a3b1e89c6835 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:40:59.930740 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bf173084-f7aa-425b-9d36-a3b1e89c6835 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:40:59.931395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-bf173084-f7aa-425b-9d36-a3b1e89c6835 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:00.074961 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-bf173084-f7aa-425b-9d36-a3b1e89c6835 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:00.083117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-bf173084-f7aa-425b-9d36-a3b1e89c6835 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1576 microversion: 2.1 time: 0.165518 Jun 30 16:41:00.083707 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 464/906] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:40:59 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:41:00.088208 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c3053f8f-3d6f-4a2e-abb7-715354fd9ce9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:00.088815 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c3053f8f-3d6f-4a2e-abb7-715354fd9ce9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:00.095227 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3053f8f-3d6f-4a2e-abb7-715354fd9ce9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:00.095654 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3053f8f-3d6f-4a2e-abb7-715354fd9ce9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:00.096423 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3053f8f-3d6f-4a2e-abb7-715354fd9ce9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:00.096866 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3053f8f-3d6f-4a2e-abb7-715354fd9ce9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:00.227795 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c3053f8f-3d6f-4a2e-abb7-715354fd9ce9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:00.236729 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c3053f8f-3d6f-4a2e-abb7-715354fd9ce9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:00.239104 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c3053f8f-3d6f-4a2e-abb7-715354fd9ce9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:00.240493 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c3053f8f-3d6f-4a2e-abb7-715354fd9ce9 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1717 microversion: 2.20 time: 0.155805 Jun 30 16:41:00.241141 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 465/907] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:41:00 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:41:00.486258 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-16d68235-3eec-445a-a89b-6b3e56733113 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.442744 Jun 30 16:41:00.487227 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 443/908] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:40:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 16:41:00.498025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8432bb5c-e862-4e9b-9cf9-c04a3d8eca38 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:00.498823 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8432bb5c-e862-4e9b-9cf9-c04a3d8eca38 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:00.554715 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8432bb5c-e862-4e9b-9cf9-c04a3d8eca38 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:00.561826 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8432bb5c-e862-4e9b-9cf9-c04a3d8eca38 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1094 microversion: 2.1 time: 0.067617 Jun 30 16:41:00.578191 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 466/909] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:00 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:01.106037 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0176d95b-d610-4e6e-877d-af8baa491189 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:01.106037 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0176d95b-d610-4e6e-877d-af8baa491189 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:01.111176 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0176d95b-d610-4e6e-877d-af8baa491189 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:01.111885 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0176d95b-d610-4e6e-877d-af8baa491189 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:01.113137 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0176d95b-d610-4e6e-877d-af8baa491189 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:01.113842 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0176d95b-d610-4e6e-877d-af8baa491189 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:01.121491 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e0430440-442e-43cb-952b-2cfd3b14d2ce tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:01.122261 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e0430440-442e-43cb-952b-2cfd3b14d2ce tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:01.132078 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e0430440-442e-43cb-952b-2cfd3b14d2ce tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:01.132827 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e0430440-442e-43cb-952b-2cfd3b14d2ce tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:01.133801 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e0430440-442e-43cb-952b-2cfd3b14d2ce tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:01.135067 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e0430440-442e-43cb-952b-2cfd3b14d2ce tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:01.232774 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-e0430440-442e-43cb-952b-2cfd3b14d2ce tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lazy-loading 'services' on Instance uuid ab43f806-fda4-432a-ac06-f950c83c9edf {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:41:01.299239 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0176d95b-d610-4e6e-877d-af8baa491189 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:01.315140 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0176d95b-d610-4e6e-877d-af8baa491189 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1576 microversion: 2.1 time: 0.217031 Jun 30 16:41:01.316383 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 444/910] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:01 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:01.321155 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-69ce3a5e-6b23-4e03-884b-dbbf97f178c7 req-a9be7bbf-ecc1-44b6-92f1-b4c4c20f4bee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d4ed30-dc39-4be8-b345-360410abdc13", "name": "network-vif-plugged", "status": "completed", "tag": "ab01136b-ddb4-42c0-b8a6-880714395a42"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:41:01.329472 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-69ce3a5e-6b23-4e03-884b-dbbf97f178c7 req-a9be7bbf-ecc1-44b6-92f1-b4c4c20f4bee service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:01.329921 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-69ce3a5e-6b23-4e03-884b-dbbf97f178c7 req-a9be7bbf-ecc1-44b6-92f1-b4c4c20f4bee service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:01.333401 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:41:01.344941 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-69ce3a5e-6b23-4e03-884b-dbbf97f178c7 req-a9be7bbf-ecc1-44b6-92f1-b4c4c20f4bee service nova] Creating event network-vif-plugged:ab01136b-ddb4-42c0-b8a6-880714395a42 for instance 68d4ed30-dc39-4be8-b345-360410abdc13 on hv-cinder-83602 Jun 30 16:41:01.350631 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-69ce3a5e-6b23-4e03-884b-dbbf97f178c7 req-a9be7bbf-ecc1-44b6-92f1-b4c4c20f4bee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033006 Jun 30 16:41:01.351457 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 445/911] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:01.580941 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-95d3b306-bb5b-41e2-b3b7-08fda8fee1aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:01.581920 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-95d3b306-bb5b-41e2-b3b7-08fda8fee1aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:01.589137 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-95d3b306-bb5b-41e2-b3b7-08fda8fee1aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:01.589586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-95d3b306-bb5b-41e2-b3b7-08fda8fee1aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:01.590353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-95d3b306-bb5b-41e2-b3b7-08fda8fee1aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:01.590787 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-95d3b306-bb5b-41e2-b3b7-08fda8fee1aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:01.620210 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e0430440-442e-43cb-952b-2cfd3b14d2ce tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments/291d3cdc-a5ce-4f89-9c2b-715a998e8602" status: 202 len: 0 microversion: 2.1 time: 0.505752 Jun 30 16:41:01.620830 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 467/912] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 30 16:41:01 2022] DELETE /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments/291d3cdc-a5ce-4f89-9c2b-715a998e8602 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 16:41:01.629856 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-088ffb6b-5f89-49b1-8563-c5663500bf72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:01.636222 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-088ffb6b-5f89-49b1-8563-c5663500bf72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:01.640806 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-088ffb6b-5f89-49b1-8563-c5663500bf72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:01.641402 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-088ffb6b-5f89-49b1-8563-c5663500bf72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:01.642187 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-088ffb6b-5f89-49b1-8563-c5663500bf72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:01.642662 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-088ffb6b-5f89-49b1-8563-c5663500bf72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:01.658750 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-95d3b306-bb5b-41e2-b3b7-08fda8fee1aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:01.668191 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-95d3b306-bb5b-41e2-b3b7-08fda8fee1aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1144 microversion: 2.1 time: 0.091913 Jun 30 16:41:01.669187 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 446/913] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:01 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:41:01.680256 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-088ffb6b-5f89-49b1-8563-c5663500bf72 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054752 Jun 30 16:41:01.680753 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 468/914] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:41:01 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:41:02.334580 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2e80e532-3df6-4aa6-b1ad-427934f05a66 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:02.335187 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2e80e532-3df6-4aa6-b1ad-427934f05a66 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:02.342493 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e80e532-3df6-4aa6-b1ad-427934f05a66 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:02.342939 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e80e532-3df6-4aa6-b1ad-427934f05a66 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:02.343784 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e80e532-3df6-4aa6-b1ad-427934f05a66 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:02.344215 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e80e532-3df6-4aa6-b1ad-427934f05a66 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:02.479530 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2e80e532-3df6-4aa6-b1ad-427934f05a66 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:02.488465 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2e80e532-3df6-4aa6-b1ad-427934f05a66 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1576 microversion: 2.1 time: 0.157417 Jun 30 16:41:02.489219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 447/915] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:02 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:02.685272 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-3c6c36da-0858-4fc6-b695-6f1b8c03dadb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:02.685821 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-3c6c36da-0858-4fc6-b695-6f1b8c03dadb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:02.688355 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:41:02.694405 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3c6c36da-0858-4fc6-b695-6f1b8c03dadb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:02.694852 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3c6c36da-0858-4fc6-b695-6f1b8c03dadb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:02.695665 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3c6c36da-0858-4fc6-b695-6f1b8c03dadb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:02.696098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3c6c36da-0858-4fc6-b695-6f1b8c03dadb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:02.697161 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c41896d2-9eb6-4750-bb09-24803be6dc12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:02.698141 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c41896d2-9eb6-4750-bb09-24803be6dc12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:02.704305 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c41896d2-9eb6-4750-bb09-24803be6dc12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:02.704753 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c41896d2-9eb6-4750-bb09-24803be6dc12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:02.710615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c41896d2-9eb6-4750-bb09-24803be6dc12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:02.710615 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c41896d2-9eb6-4750-bb09-24803be6dc12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:02.739018 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c41896d2-9eb6-4750-bb09-24803be6dc12 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045660 Jun 30 16:41:02.739664 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 448/916] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:41:02 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:41:02.766969 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-3c6c36da-0858-4fc6-b695-6f1b8c03dadb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:02.775583 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-3c6c36da-0858-4fc6-b695-6f1b8c03dadb tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1192 microversion: 2.1 time: 0.094336 Jun 30 16:41:02.776175 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 469/917] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:02 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:03.507206 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-fe2e09f2-1f39-4266-881f-b9bf80285395 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:03.507859 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-fe2e09f2-1f39-4266-881f-b9bf80285395 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:03.514432 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fe2e09f2-1f39-4266-881f-b9bf80285395 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:03.514888 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fe2e09f2-1f39-4266-881f-b9bf80285395 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:03.515842 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fe2e09f2-1f39-4266-881f-b9bf80285395 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:03.516288 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-fe2e09f2-1f39-4266-881f-b9bf80285395 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:03.661438 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-fe2e09f2-1f39-4266-881f-b9bf80285395 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:03.675898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-fe2e09f2-1f39-4266-881f-b9bf80285395 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1563 microversion: 2.1 time: 0.172448 Jun 30 16:41:03.683798 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 449/918] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:03 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1563 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:03.750706 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ab7540c6-3e5a-4bd7-844d-b729ec56f840 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:03.751719 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ab7540c6-3e5a-4bd7-844d-b729ec56f840 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:03.759103 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ab7540c6-3e5a-4bd7-844d-b729ec56f840 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:03.759508 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ab7540c6-3e5a-4bd7-844d-b729ec56f840 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:03.760456 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ab7540c6-3e5a-4bd7-844d-b729ec56f840 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:03.761056 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ab7540c6-3e5a-4bd7-844d-b729ec56f840 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:03.792819 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ab7540c6-3e5a-4bd7-844d-b729ec56f840 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046217 Jun 30 16:41:03.793025 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c1b76e3b-3487-42ef-add1-efc573c3b3d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:03.793453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 470/919] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:41:03 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:03.793535 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c1b76e3b-3487-42ef-add1-efc573c3b3d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:03.799791 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c1b76e3b-3487-42ef-add1-efc573c3b3d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:03.800869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c1b76e3b-3487-42ef-add1-efc573c3b3d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:03.801696 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c1b76e3b-3487-42ef-add1-efc573c3b3d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:03.802140 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c1b76e3b-3487-42ef-add1-efc573c3b3d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:03.865348 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c1b76e3b-3487-42ef-add1-efc573c3b3d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:03.873388 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c1b76e3b-3487-42ef-add1-efc573c3b3d7 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1210 microversion: 2.1 time: 0.084426 Jun 30 16:41:03.885572 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 450/920] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:03 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:04.805720 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-efcd17dc-46ef-4120-84b1-2d219c60cf74 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:04.806685 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-efcd17dc-46ef-4120-84b1-2d219c60cf74 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:04.813837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-efcd17dc-46ef-4120-84b1-2d219c60cf74 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:04.814553 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-efcd17dc-46ef-4120-84b1-2d219c60cf74 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:04.815378 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-efcd17dc-46ef-4120-84b1-2d219c60cf74 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:04.816468 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-efcd17dc-46ef-4120-84b1-2d219c60cf74 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:04.849318 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-efcd17dc-46ef-4120-84b1-2d219c60cf74 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047645 Jun 30 16:41:04.849909 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 471/921] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:41:04 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:04.891000 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e64a0ee4-8447-49d5-8230-eaab27288a05 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:04.891768 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e64a0ee4-8447-49d5-8230-eaab27288a05 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:04.899113 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e64a0ee4-8447-49d5-8230-eaab27288a05 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:04.899856 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e64a0ee4-8447-49d5-8230-eaab27288a05 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:04.900642 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e64a0ee4-8447-49d5-8230-eaab27288a05 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:04.901080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e64a0ee4-8447-49d5-8230-eaab27288a05 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:05.064755 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-e64a0ee4-8447-49d5-8230-eaab27288a05 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:05.076819 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e64a0ee4-8447-49d5-8230-eaab27288a05 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1278 microversion: 2.1 time: 0.189839 Jun 30 16:41:05.077953 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 451/922] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:04 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:05.368043 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-65362645-8e17-4633-8eb7-69b4a96326cc req-ac0e67ca-7f00-4ddb-af7b-b46b62e9abf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b0e8c35-fb99-4b6f-9386-e1c2a73665cf", "tag": "9418a863-c50c-466a-a9fc-f7525b264d71"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:41:05.388573 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-65362645-8e17-4633-8eb7-69b4a96326cc req-ac0e67ca-7f00-4ddb-af7b-b46b62e9abf8 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:05.389181 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-65362645-8e17-4633-8eb7-69b4a96326cc req-ac0e67ca-7f00-4ddb-af7b-b46b62e9abf8 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:05.403050 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-65362645-8e17-4633-8eb7-69b4a96326cc req-ac0e67ca-7f00-4ddb-af7b-b46b62e9abf8 service nova] Creating event network-changed:9418a863-c50c-466a-a9fc-f7525b264d71 for instance 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf on hv-cinder-83602 Jun 30 16:41:05.408069 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-65362645-8e17-4633-8eb7-69b4a96326cc req-ac0e67ca-7f00-4ddb-af7b-b46b62e9abf8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047441 Jun 30 16:41:05.408921 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 472/923] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:05.861514 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f1ee4e2b-46f4-401f-8cde-586a8e3eb231 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:05.862479 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f1ee4e2b-46f4-401f-8cde-586a8e3eb231 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:05.871310 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f1ee4e2b-46f4-401f-8cde-586a8e3eb231 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:05.871931 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f1ee4e2b-46f4-401f-8cde-586a8e3eb231 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:05.872868 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f1ee4e2b-46f4-401f-8cde-586a8e3eb231 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:05.873414 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f1ee4e2b-46f4-401f-8cde-586a8e3eb231 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:05.905546 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f1ee4e2b-46f4-401f-8cde-586a8e3eb231 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048077 Jun 30 16:41:05.906442 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 452/924] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:41:05 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:06.104316 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-26673164-b999-40c7-936d-1dd1ef11c4fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:06.105182 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-26673164-b999-40c7-936d-1dd1ef11c4fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:06.111548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-26673164-b999-40c7-936d-1dd1ef11c4fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:06.112125 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-26673164-b999-40c7-936d-1dd1ef11c4fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:06.113640 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-26673164-b999-40c7-936d-1dd1ef11c4fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:06.114019 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-26673164-b999-40c7-936d-1dd1ef11c4fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:06.256204 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-26673164-b999-40c7-936d-1dd1ef11c4fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:06.264063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-26673164-b999-40c7-936d-1dd1ef11c4fa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1278 microversion: 2.1 time: 0.164633 Jun 30 16:41:06.264638 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 473/925] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:06 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:06.917406 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-53a9ddd2-ab3e-4184-92c6-9ac3d892d405 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:06.918409 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-53a9ddd2-ab3e-4184-92c6-9ac3d892d405 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:06.925041 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-53a9ddd2-ab3e-4184-92c6-9ac3d892d405 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:06.926302 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-53a9ddd2-ab3e-4184-92c6-9ac3d892d405 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:06.926758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-53a9ddd2-ab3e-4184-92c6-9ac3d892d405 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:06.927200 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-53a9ddd2-ab3e-4184-92c6-9ac3d892d405 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:06.956920 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-53a9ddd2-ab3e-4184-92c6-9ac3d892d405 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043453 Jun 30 16:41:06.957692 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 453/926] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:41:06 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:07.281509 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f50e2a5c-cb3d-4f4d-b1e6-f0639a1854f1 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:07.282091 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f50e2a5c-cb3d-4f4d-b1e6-f0639a1854f1 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:07.289807 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f50e2a5c-cb3d-4f4d-b1e6-f0639a1854f1 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:07.290393 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f50e2a5c-cb3d-4f4d-b1e6-f0639a1854f1 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:07.291298 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f50e2a5c-cb3d-4f4d-b1e6-f0639a1854f1 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:07.291838 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f50e2a5c-cb3d-4f4d-b1e6-f0639a1854f1 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:07.440288 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f50e2a5c-cb3d-4f4d-b1e6-f0639a1854f1 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:07.448415 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f50e2a5c-cb3d-4f4d-b1e6-f0639a1854f1 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1278 microversion: 2.1 time: 0.170910 Jun 30 16:41:07.449055 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 474/927] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:07 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:07.968592 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-10ed05a5-e8e7-4808-b0a3-b780977d0492 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:07.969552 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-10ed05a5-e8e7-4808-b0a3-b780977d0492 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:07.976914 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10ed05a5-e8e7-4808-b0a3-b780977d0492 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:07.977364 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10ed05a5-e8e7-4808-b0a3-b780977d0492 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:07.978133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10ed05a5-e8e7-4808-b0a3-b780977d0492 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:07.978577 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-10ed05a5-e8e7-4808-b0a3-b780977d0492 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:08.011515 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-10ed05a5-e8e7-4808-b0a3-b780977d0492 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046816 Jun 30 16:41:08.012426 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 454/928] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:41:07 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:08.365971 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9eabc533-da9a-4d99-a17e-3570ae2db261 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:08.366942 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9eabc533-da9a-4d99-a17e-3570ae2db261 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:08.373637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9eabc533-da9a-4d99-a17e-3570ae2db261 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:08.374089 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9eabc533-da9a-4d99-a17e-3570ae2db261 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:08.374865 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9eabc533-da9a-4d99-a17e-3570ae2db261 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:08.375310 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9eabc533-da9a-4d99-a17e-3570ae2db261 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:08.407768 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9eabc533-da9a-4d99-a17e-3570ae2db261 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045605 Jun 30 16:41:08.410654 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 475/929] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:41:08 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:08.465159 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9e202f9e-cdc9-466a-ab9c-32abd7cbb6b3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:08.465829 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9e202f9e-cdc9-466a-ab9c-32abd7cbb6b3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:08.472209 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9e202f9e-cdc9-466a-ab9c-32abd7cbb6b3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:08.473115 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9e202f9e-cdc9-466a-ab9c-32abd7cbb6b3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:08.473649 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9e202f9e-cdc9-466a-ab9c-32abd7cbb6b3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:08.474088 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9e202f9e-cdc9-466a-ab9c-32abd7cbb6b3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:08.545380 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6e5ceb68-ceec-4eda-9d97-f97e2fed1f28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:08.545805 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6e5ceb68-ceec-4eda-9d97-f97e2fed1f28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:08.553854 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6e5ceb68-ceec-4eda-9d97-f97e2fed1f28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:08.554308 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6e5ceb68-ceec-4eda-9d97-f97e2fed1f28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:08.555139 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6e5ceb68-ceec-4eda-9d97-f97e2fed1f28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:08.555664 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6e5ceb68-ceec-4eda-9d97-f97e2fed1f28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:08.590027 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6e5ceb68-ceec-4eda-9d97-f97e2fed1f28 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments/8afeb482-1371-4e3d-81c9-f7091a4d4ba2" status: 200 len: 194 microversion: 2.1 time: 0.048960 Jun 30 16:41:08.591065 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 476/930] 10.222.0.67 () {58 vars in 1412 bytes} [Thu Jun 30 16:41:08 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments/8afeb482-1371-4e3d-81c9-f7091a4d4ba2 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:41:08.601912 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-94f700dc-e832-4cd1-80f4-fb18a6487b90 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:08.602429 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-94f700dc-e832-4cd1-80f4-fb18a6487b90 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:08.609139 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94f700dc-e832-4cd1-80f4-fb18a6487b90 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:08.609596 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94f700dc-e832-4cd1-80f4-fb18a6487b90 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:08.610400 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94f700dc-e832-4cd1-80f4-fb18a6487b90 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:08.610844 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-94f700dc-e832-4cd1-80f4-fb18a6487b90 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:08.704708 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-94f700dc-e832-4cd1-80f4-fb18a6487b90 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lazy-loading 'services' on Instance uuid cfa43141-bf18-4671-bcfe-fcc4b0b32da0 {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:41:08.708819 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:41:08.871826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9e202f9e-cdc9-466a-ab9c-32abd7cbb6b3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:08.879604 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9e202f9e-cdc9-466a-ab9c-32abd7cbb6b3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1278 microversion: 2.1 time: 0.418119 Jun 30 16:41:08.880193 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 455/931] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:08 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1278 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:08.957456 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-94f700dc-e832-4cd1-80f4-fb18a6487b90 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments/8afeb482-1371-4e3d-81c9-f7091a4d4ba2" status: 202 len: 0 microversion: 2.1 time: 0.359484 Jun 30 16:41:08.958054 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 477/932] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 30 16:41:08 2022] DELETE /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments/8afeb482-1371-4e3d-81c9-f7091a4d4ba2 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 16:41:09.023367 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2e6ca37c-c99f-4db3-a9b4-0a2a5151d50e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:09.024639 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2e6ca37c-c99f-4db3-a9b4-0a2a5151d50e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:09.031129 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e6ca37c-c99f-4db3-a9b4-0a2a5151d50e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:09.031620 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e6ca37c-c99f-4db3-a9b4-0a2a5151d50e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:09.032470 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e6ca37c-c99f-4db3-a9b4-0a2a5151d50e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:09.032876 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2e6ca37c-c99f-4db3-a9b4-0a2a5151d50e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:09.069383 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2e6ca37c-c99f-4db3-a9b4-0a2a5151d50e tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050503 Jun 30 16:41:09.069892 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 456/933] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:41:09 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 16:41:09.133928 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4335bb6c-4878-40a6-b654-33031f05ca86 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:09.136015 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4335bb6c-4878-40a6-b654-33031f05ca86 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:09.142829 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4335bb6c-4878-40a6-b654-33031f05ca86 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:09.143271 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4335bb6c-4878-40a6-b654-33031f05ca86 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:09.144597 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4335bb6c-4878-40a6-b654-33031f05ca86 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:09.145694 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4335bb6c-4878-40a6-b654-33031f05ca86 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:09.172691 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4335bb6c-4878-40a6-b654-33031f05ca86 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Going to try to terminate instance {{(pid=124815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:41:09.552796 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-4335bb6c-4878-40a6-b654-33031f05ca86 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 204 len: 0 microversion: 2.1 time: 0.422895 Jun 30 16:41:09.553938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 478/934] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:41:09 2022] DELETE /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:41:09.562534 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5b0b7054-4b1c-4f53-a956-21b6571b9503 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:09.563148 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5b0b7054-4b1c-4f53-a956-21b6571b9503 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:09.570487 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5b0b7054-4b1c-4f53-a956-21b6571b9503 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:09.570951 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5b0b7054-4b1c-4f53-a956-21b6571b9503 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:09.571772 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5b0b7054-4b1c-4f53-a956-21b6571b9503 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:09.572215 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5b0b7054-4b1c-4f53-a956-21b6571b9503 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:09.594403 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=2 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:41:09.617264 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=6 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:41:09.718205 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5b0b7054-4b1c-4f53-a956-21b6571b9503 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:09.726701 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5b0b7054-4b1c-4f53-a956-21b6571b9503 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1681 microversion: 2.1 time: 0.167997 Jun 30 16:41:09.727289 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 457/935] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:09 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:09.897928 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-648caa16-10b2-4347-979e-0016a0fc3097 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:09.898628 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-648caa16-10b2-4347-979e-0016a0fc3097 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:09.904867 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-648caa16-10b2-4347-979e-0016a0fc3097 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:09.905316 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-648caa16-10b2-4347-979e-0016a0fc3097 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:09.906083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-648caa16-10b2-4347-979e-0016a0fc3097 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:09.906518 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-648caa16-10b2-4347-979e-0016a0fc3097 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:10.052319 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-648caa16-10b2-4347-979e-0016a0fc3097 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:10.061409 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-648caa16-10b2-4347-979e-0016a0fc3097 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1278 microversion: 2.1 time: 0.168570 Jun 30 16:41:10.062175 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 479/936] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:09 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:10.745036 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8fdaa1b3-3395-4e34-ba55-20fdef525544 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:10.745659 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8fdaa1b3-3395-4e34-ba55-20fdef525544 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:10.752825 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8fdaa1b3-3395-4e34-ba55-20fdef525544 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:10.753288 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8fdaa1b3-3395-4e34-ba55-20fdef525544 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:10.754846 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8fdaa1b3-3395-4e34-ba55-20fdef525544 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:10.755298 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8fdaa1b3-3395-4e34-ba55-20fdef525544 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:10.893091 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8fdaa1b3-3395-4e34-ba55-20fdef525544 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:10.902444 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8fdaa1b3-3395-4e34-ba55-20fdef525544 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1681 microversion: 2.1 time: 0.161005 Jun 30 16:41:10.904053 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 458/937] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:10 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:11.080719 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c4459b10-191e-4325-9e63-9e28c9c565ca tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:11.081440 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c4459b10-191e-4325-9e63-9e28c9c565ca tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:11.084368 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:41:11.089448 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c4459b10-191e-4325-9e63-9e28c9c565ca tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:11.091853 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c4459b10-191e-4325-9e63-9e28c9c565ca tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:11.091853 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c4459b10-191e-4325-9e63-9e28c9c565ca tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:11.091853 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c4459b10-191e-4325-9e63-9e28c9c565ca tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:11.240940 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c4459b10-191e-4325-9e63-9e28c9c565ca tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:11.249050 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c4459b10-191e-4325-9e63-9e28c9c565ca tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1278 microversion: 2.1 time: 0.172269 Jun 30 16:41:11.249639 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 480/938] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:11 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:11.922197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a087519a-7c44-48e3-8280-b832b0effe62 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:11.922823 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a087519a-7c44-48e3-8280-b832b0effe62 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:11.925195 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:41:11.930673 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a087519a-7c44-48e3-8280-b832b0effe62 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:11.931128 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a087519a-7c44-48e3-8280-b832b0effe62 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:11.931916 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a087519a-7c44-48e3-8280-b832b0effe62 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:11.932350 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a087519a-7c44-48e3-8280-b832b0effe62 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:12.001430 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a087519a-7c44-48e3-8280-b832b0effe62 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:12.012962 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a087519a-7c44-48e3-8280-b832b0effe62 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1613 microversion: 2.1 time: 0.094393 Jun 30 16:41:12.013903 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 459/939] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:11 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1613 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:12.267243 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-cd03390c-bc14-41ed-ad63-e25d9f141408 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:12.267966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-cd03390c-bc14-41ed-ad63-e25d9f141408 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:12.276319 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cd03390c-bc14-41ed-ad63-e25d9f141408 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:12.276777 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cd03390c-bc14-41ed-ad63-e25d9f141408 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:12.278121 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cd03390c-bc14-41ed-ad63-e25d9f141408 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:12.278725 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cd03390c-bc14-41ed-ad63-e25d9f141408 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:12.289444 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-c4d80294-a41c-403d-ab0e-72db70daa797 req-c9951c4e-368f-48a9-b985-88d22dff0375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab43f806-fda4-432a-ac06-f950c83c9edf", "name": "network-vif-deleted", "tag": "1b8b879d-fbe8-4d64-bc33-b23f193e7b6d"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:41:12.303494 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-c4d80294-a41c-403d-ab0e-72db70daa797 req-c9951c4e-368f-48a9-b985-88d22dff0375 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:12.305015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-c4d80294-a41c-403d-ab0e-72db70daa797 req-c9951c4e-368f-48a9-b985-88d22dff0375 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:12.317478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-c4d80294-a41c-403d-ab0e-72db70daa797 req-c9951c4e-368f-48a9-b985-88d22dff0375 service nova] Creating event network-vif-deleted:1b8b879d-fbe8-4d64-bc33-b23f193e7b6d for instance ab43f806-fda4-432a-ac06-f950c83c9edf on hv-cinder-83602 Jun 30 16:41:12.322644 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-c4d80294-a41c-403d-ab0e-72db70daa797 req-c9951c4e-368f-48a9-b985-88d22dff0375 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038954 Jun 30 16:41:12.323243 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 460/940] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:41:12.459294 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-cd03390c-bc14-41ed-ad63-e25d9f141408 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:12.468135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-cd03390c-bc14-41ed-ad63-e25d9f141408 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1266 microversion: 2.1 time: 0.205004 Jun 30 16:41:12.468722 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 481/941] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:12 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:13.031314 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6e7c81f9-3fab-4912-a2a0-41a841335b94 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:13.032232 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6e7c81f9-3fab-4912-a2a0-41a841335b94 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:13.040056 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6e7c81f9-3fab-4912-a2a0-41a841335b94 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:13.040565 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6e7c81f9-3fab-4912-a2a0-41a841335b94 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:13.041412 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6e7c81f9-3fab-4912-a2a0-41a841335b94 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:13.041858 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6e7c81f9-3fab-4912-a2a0-41a841335b94 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:13.075755 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6e7c81f9-3fab-4912-a2a0-41a841335b94 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:13.076214 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6e7c81f9-3fab-4912-a2a0-41a841335b94 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:13.076678 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-6e7c81f9-3fab-4912-a2a0-41a841335b94 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lazy-loading 'fault' on Instance uuid ab43f806-fda4-432a-ac06-f950c83c9edf {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:41:13.124497 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6e7c81f9-3fab-4912-a2a0-41a841335b94 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a26028451b345968fe86774f44736dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f942ab31bafc428bb1fba94aee2e0c32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:13.134651 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6e7c81f9-3fab-4912-a2a0-41a841335b94 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 200 len: 1331 microversion: 2.1 time: 0.106596 Jun 30 16:41:13.134651 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 461/942] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:13 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:13.273420 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6b349521-b011-4280-ad19-3300cd80ea4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:13.273959 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6b349521-b011-4280-ad19-3300cd80ea4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:13.280773 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6b349521-b011-4280-ad19-3300cd80ea4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:13.281317 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6b349521-b011-4280-ad19-3300cd80ea4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:13.282168 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6b349521-b011-4280-ad19-3300cd80ea4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:13.282666 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6b349521-b011-4280-ad19-3300cd80ea4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:13.314436 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6b349521-b011-4280-ad19-3300cd80ea4b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments/4371250a-8795-4b3f-a86f-7519f6cb0cb0" status: 200 len: 194 microversion: 2.1 time: 0.046610 Jun 30 16:41:13.319520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 482/943] 10.222.0.67 () {58 vars in 1412 bytes} [Thu Jun 30 16:41:13 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments/4371250a-8795-4b3f-a86f-7519f6cb0cb0 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:13.325930 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-db4504d1-f652-43d5-99ce-38865a389416 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:13.326777 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-db4504d1-f652-43d5-99ce-38865a389416 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:13.333885 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-db4504d1-f652-43d5-99ce-38865a389416 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:13.334348 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-db4504d1-f652-43d5-99ce-38865a389416 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:13.335139 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-db4504d1-f652-43d5-99ce-38865a389416 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:13.335621 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-db4504d1-f652-43d5-99ce-38865a389416 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:13.418965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=100 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:41:13.424028 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-db4504d1-f652-43d5-99ce-38865a389416 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lazy-loading 'services' on Instance uuid cfa43141-bf18-4671-bcfe-fcc4b0b32da0 {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:41:13.485703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c5ec4ab7-c10c-4ef5-9402-8b98faa08d4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:13.486316 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c5ec4ab7-c10c-4ef5-9402-8b98faa08d4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:13.492589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c5ec4ab7-c10c-4ef5-9402-8b98faa08d4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:13.493053 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c5ec4ab7-c10c-4ef5-9402-8b98faa08d4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:13.493833 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c5ec4ab7-c10c-4ef5-9402-8b98faa08d4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:13.494277 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c5ec4ab7-c10c-4ef5-9402-8b98faa08d4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:13.659154 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c5ec4ab7-c10c-4ef5-9402-8b98faa08d4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:13.667268 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c5ec4ab7-c10c-4ef5-9402-8b98faa08d4f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1266 microversion: 2.1 time: 0.185391 Jun 30 16:41:13.669851 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 483/944] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:13 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:41:13.735684 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-db4504d1-f652-43d5-99ce-38865a389416 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments/4371250a-8795-4b3f-a86f-7519f6cb0cb0" status: 202 len: 0 microversion: 2.1 time: 0.413522 Jun 30 16:41:13.738686 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 462/945] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 30 16:41:13 2022] DELETE /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments/4371250a-8795-4b3f-a86f-7519f6cb0cb0 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:41:14.150995 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-23510d2d-56c4-44e4-a6b0-ae36665e763d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:14.151641 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-23510d2d-56c4-44e4-a6b0-ae36665e763d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:14.157868 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-23510d2d-56c4-44e4-a6b0-ae36665e763d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:14.158320 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-23510d2d-56c4-44e4-a6b0-ae36665e763d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:14.159089 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-23510d2d-56c4-44e4-a6b0-ae36665e763d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:14.159846 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-23510d2d-56c4-44e4-a6b0-ae36665e763d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:14.173783 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-23510d2d-56c4-44e4-a6b0-ae36665e763d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] HTTP exception thrown: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-23510d2d-56c4-44e4-a6b0-ae36665e763d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Request method failure captured: Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf HTTP/1.1 Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdByCRmKHFn3MWHXG9FHLumdqoFbcitofz3WTo4vIsqDgEdQTbCYdYkG6VrKJfwKSwNBul_mR6Pq6q8wsCNMbsOQVU-vBawcL74Th9xNCcWYhdHHThpX8bYg_ks1_lfyxu2cd7ltcDmgXQzda0-vc83XxV9QJd6mMtTnGfzh1bTh8BQ Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:14.175637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:14.177321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f942ab31bafc428bb1fba94aee2e0c32"}]}] Jun 30 16:41:14.177321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:14.177321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:14.177321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:14.177321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:14.177321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:14.177321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:14.177321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 0a26028451b345968fe86774f44736dd Jun 30 16:41:14.177321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:14.177321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:41:14.177321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:14.177321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'ab43f806-fda4-432a-ac06-f950c83c9edf'} Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:14.178245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:14.179703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:14.181057 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-23510d2d-56c4-44e4-a6b0-ae36665e763d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Returning 404 to user: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:14.181057 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-23510d2d-56c4-44e4-a6b0-ae36665e763d tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 404 len: 111 microversion: 2.1 time: 0.030004 Jun 30 16:41:14.181057 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 484/946] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:14 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:41:14.187769 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8728d524-4b00-4300-bb00-ec60c0b1758b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '.version_select at 0x7f38201a2ee0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:14.366550 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8728d524-4b00-4300-bb00-ec60c0b1758b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2019523306" status: 202 len: 0 microversion: 2.1 time: 0.184056 Jun 30 16:41:14.367157 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 463/947] 10.222.0.67 () {58 vars in 1220 bytes} [Thu Jun 30 16:41:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2019523306 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:41:14.688736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-0e0b9574-317f-462f-ac7d-f92536b1c761 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:14.690159 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-0e0b9574-317f-462f-ac7d-f92536b1c761 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:14.703575 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0e0b9574-317f-462f-ac7d-f92536b1c761 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:14.704628 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0e0b9574-317f-462f-ac7d-f92536b1c761 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:14.706010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0e0b9574-317f-462f-ac7d-f92536b1c761 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:14.707009 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-0e0b9574-317f-462f-ac7d-f92536b1c761 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:14.880150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-0e0b9574-317f-462f-ac7d-f92536b1c761 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:14.890360 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-0e0b9574-317f-462f-ac7d-f92536b1c761 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1266 microversion: 2.1 time: 0.209071 Jun 30 16:41:14.898650 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 485/948] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:14 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:41:14.921537 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-23cf1431-2242-4478-afe7-790a678a5674 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:14.922655 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-23cf1431-2242-4478-afe7-790a678a5674 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:14.930097 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-23cf1431-2242-4478-afe7-790a678a5674 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:14.930574 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-23cf1431-2242-4478-afe7-790a678a5674 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:14.931548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-23cf1431-2242-4478-afe7-790a678a5674 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:14.932004 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-23cf1431-2242-4478-afe7-790a678a5674 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:14.966810 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-23cf1431-2242-4478-afe7-790a678a5674 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049207 Jun 30 16:41:14.967510 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 464/949] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:41:14 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 16:41:15.080839 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2f2c1d5c-3e00-404b-ad6e-fd392aeccefa tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:15.082340 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2f2c1d5c-3e00-404b-ad6e-fd392aeccefa tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:15.088620 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2f2c1d5c-3e00-404b-ad6e-fd392aeccefa tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:15.089063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2f2c1d5c-3e00-404b-ad6e-fd392aeccefa tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:15.089835 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2f2c1d5c-3e00-404b-ad6e-fd392aeccefa tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:15.090272 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2f2c1d5c-3e00-404b-ad6e-fd392aeccefa tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:15.121249 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2f2c1d5c-3e00-404b-ad6e-fd392aeccefa tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044320 Jun 30 16:41:15.121790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 486/950] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:41:15 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 16:41:15.182191 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3f7b1012-6cfe-4750-8880-61b3c0d25e67 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:15.182688 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3f7b1012-6cfe-4750-8880-61b3c0d25e67 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:15.192285 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3f7b1012-6cfe-4750-8880-61b3c0d25e67 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:15.192916 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3f7b1012-6cfe-4750-8880-61b3c0d25e67 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:15.193498 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3f7b1012-6cfe-4750-8880-61b3c0d25e67 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:15.193940 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3f7b1012-6cfe-4750-8880-61b3c0d25e67 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:15.225074 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3f7b1012-6cfe-4750-8880-61b3c0d25e67 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Going to try to terminate instance {{(pid=124814) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:41:15.500022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3f7b1012-6cfe-4750-8880-61b3c0d25e67 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 204 len: 0 microversion: 2.1 time: 0.321567 Jun 30 16:41:15.500857 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 465/951] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:41:15 2022] DELETE /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:41:15.510508 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c180aec8-c320-47c9-8d8c-d83bcfd8802b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:15.511126 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c180aec8-c320-47c9-8d8c-d83bcfd8802b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:15.517310 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c180aec8-c320-47c9-8d8c-d83bcfd8802b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:15.517771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c180aec8-c320-47c9-8d8c-d83bcfd8802b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:15.518548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c180aec8-c320-47c9-8d8c-d83bcfd8802b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:15.519027 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c180aec8-c320-47c9-8d8c-d83bcfd8802b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:15.653317 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c180aec8-c320-47c9-8d8c-d83bcfd8802b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:15.661033 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c180aec8-c320-47c9-8d8c-d83bcfd8802b tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1672 microversion: 2.1 time: 0.154527 Jun 30 16:41:15.661617 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 487/952] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:15 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:15.907786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-91b6abb0-06f8-4b17-86a1-be15ff9d5116 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:15.908490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-91b6abb0-06f8-4b17-86a1-be15ff9d5116 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:15.915293 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-91b6abb0-06f8-4b17-86a1-be15ff9d5116 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:15.915774 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-91b6abb0-06f8-4b17-86a1-be15ff9d5116 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:15.916554 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-91b6abb0-06f8-4b17-86a1-be15ff9d5116 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:15.917207 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-91b6abb0-06f8-4b17-86a1-be15ff9d5116 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:16.068972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-91b6abb0-06f8-4b17-86a1-be15ff9d5116 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:16.076870 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-91b6abb0-06f8-4b17-86a1-be15ff9d5116 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1266 microversion: 2.1 time: 0.173389 Jun 30 16:41:16.077449 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 466/953] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:15 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:16.517739 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-63d26815-4714-4e06-816d-2f53f3dd4bad tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:16.518272 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-63d26815-4714-4e06-816d-2f53f3dd4bad tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:16.524871 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-63d26815-4714-4e06-816d-2f53f3dd4bad tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:16.525322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-63d26815-4714-4e06-816d-2f53f3dd4bad tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:16.526125 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-63d26815-4714-4e06-816d-2f53f3dd4bad tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:16.526565 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-63d26815-4714-4e06-816d-2f53f3dd4bad tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:16.540982 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-63d26815-4714-4e06-816d-2f53f3dd4bad tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] HTTP exception thrown: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-63d26815-4714-4e06-816d-2f53f3dd4bad tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Request method failure captured: Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: DELETE /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf HTTP/1.1 Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdByCRmKHFn3MWHXG9FHLumdqoFbcitofz3WTo4vIsqDgEdQTbCYdYkG6VrKJfwKSwNBul_mR6Pq6q8wsCNMbsOQVU-vBawcL74Th9xNCcWYhdHHThpX8bYg_ks1_lfyxu2cd7ltcDmgXQzda0-vc83XxV9QJd6mMtTnGfzh1bTh8BQ Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:16.542539 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:16.544559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f942ab31bafc428bb1fba94aee2e0c32"}]}] Jun 30 16:41:16.544559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:16.544559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:16.544559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:16.544559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:16.544559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:16.544559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:16.544559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 0a26028451b345968fe86774f44736dd Jun 30 16:41:16.544559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:16.544559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:41:16.544559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:16.544559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'ab43f806-fda4-432a-ac06-f950c83c9edf'} Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:16.546029 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:16.547541 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:16.548981 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-63d26815-4714-4e06-816d-2f53f3dd4bad tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Returning 404 to user: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:16.548981 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-63d26815-4714-4e06-816d-2f53f3dd4bad tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 404 len: 111 microversion: 2.1 time: 0.030160 Jun 30 16:41:16.548981 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 488/954] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:41:16 2022] DELETE /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:41:16.554189 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ff2b381b-12cf-4898-82b7-a9a20e05b020 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:16.554949 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ff2b381b-12cf-4898-82b7-a9a20e05b020 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: ab43f806-fda4-432a-ac06-f950c83c9edf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:16.561512 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ff2b381b-12cf-4898-82b7-a9a20e05b020 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:16.561952 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ff2b381b-12cf-4898-82b7-a9a20e05b020 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:16.562714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ff2b381b-12cf-4898-82b7-a9a20e05b020 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:16.563146 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ff2b381b-12cf-4898-82b7-a9a20e05b020 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:16.578583 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-ff2b381b-12cf-4898-82b7-a9a20e05b020 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] HTTP exception thrown: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ff2b381b-12cf-4898-82b7-a9a20e05b020 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Request method failure captured: Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf HTTP/1.1 Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdByCRmKHFn3MWHXG9FHLumdqoFbcitofz3WTo4vIsqDgEdQTbCYdYkG6VrKJfwKSwNBul_mR6Pq6q8wsCNMbsOQVU-vBawcL74Th9xNCcWYhdHHThpX8bYg_ks1_lfyxu2cd7ltcDmgXQzda0-vc83XxV9QJd6mMtTnGfzh1bTh8BQ Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:41:16.580407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:41:16.583781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f942ab31bafc428bb1fba94aee2e0c32"}]}] Jun 30 16:41:16.583781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:16.583781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:16.583781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:16.583781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:16.583781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:41:16.583781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:41:16.583781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 0a26028451b345968fe86774f44736dd Jun 30 16:41:16.583781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:16.583781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:41:16.583781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:16.583781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': 'ab43f806-fda4-432a-ac06-f950c83c9edf'} Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:16.584760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. Jun 30 16:41:16.586221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:16.587649 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ff2b381b-12cf-4898-82b7-a9a20e05b020 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Returning 404 to user: Instance ab43f806-fda4-432a-ac06-f950c83c9edf could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:16.587649 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ff2b381b-12cf-4898-82b7-a9a20e05b020 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf" status: 404 len: 111 microversion: 2.1 time: 0.033118 Jun 30 16:41:16.587649 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 467/955] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:16 2022] GET /compute/v2.1/servers/ab43f806-fda4-432a-ac06-f950c83c9edf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:41:16.678682 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-670426de-0802-4703-b399-184c7d7a0b8e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:16.679300 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-670426de-0802-4703-b399-184c7d7a0b8e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:16.685782 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-670426de-0802-4703-b399-184c7d7a0b8e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:16.686288 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-670426de-0802-4703-b399-184c7d7a0b8e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:16.687109 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-670426de-0802-4703-b399-184c7d7a0b8e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:16.687666 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-670426de-0802-4703-b399-184c7d7a0b8e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:16.826297 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-670426de-0802-4703-b399-184c7d7a0b8e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:16.834972 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-670426de-0802-4703-b399-184c7d7a0b8e tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1672 microversion: 2.1 time: 0.160255 Jun 30 16:41:16.835611 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 489/956] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:16 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:17.094512 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ff094d1e-048b-4183-b038-9151c0755fd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:17.095167 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ff094d1e-048b-4183-b038-9151c0755fd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:17.101350 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ff094d1e-048b-4183-b038-9151c0755fd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:17.101690 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ff094d1e-048b-4183-b038-9151c0755fd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:17.102459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ff094d1e-048b-4183-b038-9151c0755fd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:17.102913 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ff094d1e-048b-4183-b038-9151c0755fd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:17.248392 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ff094d1e-048b-4183-b038-9151c0755fd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:17.262598 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ff094d1e-048b-4183-b038-9151c0755fd3 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1266 microversion: 2.1 time: 0.171881 Jun 30 16:41:17.263195 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 468/957] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:17 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:17.479637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-c7822a9e-0a3e-4a31-9b7d-b7fc4566654c req-eb18ab6f-b12e-431d-9014-e1db98986f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b0e8c35-fb99-4b6f-9386-e1c2a73665cf", "name": "network-vif-plugged", "status": "completed", "tag": "9418a863-c50c-466a-a9fc-f7525b264d71"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:41:17.488950 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-c7822a9e-0a3e-4a31-9b7d-b7fc4566654c req-eb18ab6f-b12e-431d-9014-e1db98986f9a service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:17.489479 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-c7822a9e-0a3e-4a31-9b7d-b7fc4566654c req-eb18ab6f-b12e-431d-9014-e1db98986f9a service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:17.500758 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-c7822a9e-0a3e-4a31-9b7d-b7fc4566654c req-eb18ab6f-b12e-431d-9014-e1db98986f9a service nova] Creating event network-vif-plugged:9418a863-c50c-466a-a9fc-f7525b264d71 for instance 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf on hv-cinder-83602 Jun 30 16:41:17.508670 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-c7822a9e-0a3e-4a31-9b7d-b7fc4566654c req-eb18ab6f-b12e-431d-9014-e1db98986f9a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031464 Jun 30 16:41:17.508670 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 490/958] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:17.854905 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-95004245-51af-4845-b3d5-b2cb4579fc72 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:17.855636 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-95004245-51af-4845-b3d5-b2cb4579fc72 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:17.862507 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-95004245-51af-4845-b3d5-b2cb4579fc72 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:17.863031 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-95004245-51af-4845-b3d5-b2cb4579fc72 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:17.864595 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-95004245-51af-4845-b3d5-b2cb4579fc72 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:17.870981 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-95004245-51af-4845-b3d5-b2cb4579fc72 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:17.888992 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-cb9aee8b-cd88-46bc-a17e-b65c0b6b8cdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:17.899864 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-cb9aee8b-cd88-46bc-a17e-b65c0b6b8cdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:17.899864 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cb9aee8b-cd88-46bc-a17e-b65c0b6b8cdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:17.899864 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cb9aee8b-cd88-46bc-a17e-b65c0b6b8cdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:17.899864 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cb9aee8b-cd88-46bc-a17e-b65c0b6b8cdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:17.900290 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-cb9aee8b-cd88-46bc-a17e-b65c0b6b8cdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:17.924353 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-cb9aee8b-cd88-46bc-a17e-b65c0b6b8cdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] HTTP exception thrown: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-cb9aee8b-cd88-46bc-a17e-b65c0b6b8cdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Request method failure captured: Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: DELETE /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 HTTP/1.1 Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdByCRmKHFn3MWHXG9FHLumdqoFbcitofz3WTo4vIsqDgEdQTbCYdYkG6VrKJfwKSwNBul_mR6Pq6q8wsCNMbsOQVU-vBawcL74Th9xNCcWYhdHHThpX8bYg_ks1_lfyxu2cd7ltcDmgXQzda0-vc83XxV9QJd6mMtTnGfzh1bTh8BQ Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:17.927203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:17.929158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f942ab31bafc428bb1fba94aee2e0c32"}]}] Jun 30 16:41:17.929158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:17.929158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:17.929158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:17.929158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:17.929158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:17.929158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:17.929158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 0a26028451b345968fe86774f44736dd Jun 30 16:41:17.929158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:17.929158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:41:17.929158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:41:17.929158 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': '4eddee8f-330d-43f7-8877-50a589622e55'} Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:17.929979 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:41:17.931419 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:17.933056 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-cb9aee8b-cd88-46bc-a17e-b65c0b6b8cdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Returning 404 to user: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:17.933056 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-cb9aee8b-cd88-46bc-a17e-b65c0b6b8cdc tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 404 len: 111 microversion: 2.1 time: 0.044264 Jun 30 16:41:17.933056 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 491/959] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:41:17 2022] DELETE /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 16:41:17.938324 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ef215ff1-fd86-4129-8699-d5a6148fb470 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:17.939039 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ef215ff1-fd86-4129-8699-d5a6148fb470 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 4eddee8f-330d-43f7-8877-50a589622e55] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:17.947088 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ef215ff1-fd86-4129-8699-d5a6148fb470 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:17.954150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ef215ff1-fd86-4129-8699-d5a6148fb470 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:17.954150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ef215ff1-fd86-4129-8699-d5a6148fb470 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:17.954150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ef215ff1-fd86-4129-8699-d5a6148fb470 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:17.964909 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-ef215ff1-fd86-4129-8699-d5a6148fb470 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] HTTP exception thrown: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ef215ff1-fd86-4129-8699-d5a6148fb470 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Request method failure captured: Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 HTTP/1.1 Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdByCRmKHFn3MWHXG9FHLumdqoFbcitofz3WTo4vIsqDgEdQTbCYdYkG6VrKJfwKSwNBul_mR6Pq6q8wsCNMbsOQVU-vBawcL74Th9xNCcWYhdHHThpX8bYg_ks1_lfyxu2cd7ltcDmgXQzda0-vc83XxV9QJd6mMtTnGfzh1bTh8BQ Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:17.966686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:17.968944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f942ab31bafc428bb1fba94aee2e0c32"}]}] Jun 30 16:41:17.968944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:17.968944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:17.968944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:17.968944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:17.968944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:17.968944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:17.968944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 0a26028451b345968fe86774f44736dd Jun 30 16:41:17.968944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:17.968944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:41:17.968944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:41:17.968944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': '4eddee8f-330d-43f7-8877-50a589622e55'} Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:17.969840 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. Jun 30 16:41:17.971260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:17.973156 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ef215ff1-fd86-4129-8699-d5a6148fb470 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Returning 404 to user: Instance 4eddee8f-330d-43f7-8877-50a589622e55 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:17.973156 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ef215ff1-fd86-4129-8699-d5a6148fb470 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55" status: 404 len: 111 microversion: 2.1 time: 0.036617 Jun 30 16:41:17.974559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 492/960] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:17 2022] GET /compute/v2.1/servers/4eddee8f-330d-43f7-8877-50a589622e55 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 16:41:17.981817 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-3fcf2eaa-a24f-4e13-8c1c-eedbef96604b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:17.982915 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-3fcf2eaa-a24f-4e13-8c1c-eedbef96604b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:17.990134 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3fcf2eaa-a24f-4e13-8c1c-eedbef96604b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:17.990640 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3fcf2eaa-a24f-4e13-8c1c-eedbef96604b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:17.997501 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3fcf2eaa-a24f-4e13-8c1c-eedbef96604b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:17.997501 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3fcf2eaa-a24f-4e13-8c1c-eedbef96604b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:18.013141 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-3fcf2eaa-a24f-4e13-8c1c-eedbef96604b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] HTTP exception thrown: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-3fcf2eaa-a24f-4e13-8c1c-eedbef96604b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Request method failure captured: Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: DELETE /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 HTTP/1.1 Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdByCRmKHFn3MWHXG9FHLumdqoFbcitofz3WTo4vIsqDgEdQTbCYdYkG6VrKJfwKSwNBul_mR6Pq6q8wsCNMbsOQVU-vBawcL74Th9xNCcWYhdHHThpX8bYg_ks1_lfyxu2cd7ltcDmgXQzda0-vc83XxV9QJd6mMtTnGfzh1bTh8BQ Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:18.014813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:18.016461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f942ab31bafc428bb1fba94aee2e0c32"}]}] Jun 30 16:41:18.016461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:18.016461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:18.016461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:18.016461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:18.016461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:18.016461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:18.016461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 0a26028451b345968fe86774f44736dd Jun 30 16:41:18.016461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:18.016461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:41:18.016461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:41:18.016461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'de05418a-11bf-401c-b0cb-52968e5d6d07'} Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:18.017254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:41:18.018413 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:18.019772 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-3fcf2eaa-a24f-4e13-8c1c-eedbef96604b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Returning 404 to user: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:18.019772 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-3fcf2eaa-a24f-4e13-8c1c-eedbef96604b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 404 len: 111 microversion: 2.1 time: 0.038338 Jun 30 16:41:18.019772 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 493/961] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:41:17 2022] DELETE /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 16:41:18.025438 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7ccaecd4-b3ae-4248-a67a-f9cfb8227fd8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:18.025805 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-7ccaecd4-b3ae-4248-a67a-f9cfb8227fd8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: de05418a-11bf-401c-b0cb-52968e5d6d07] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:18.029293 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-95004245-51af-4845-b3d5-b2cb4579fc72 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:18.032125 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7ccaecd4-b3ae-4248-a67a-f9cfb8227fd8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:18.032578 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7ccaecd4-b3ae-4248-a67a-f9cfb8227fd8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:18.033350 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7ccaecd4-b3ae-4248-a67a-f9cfb8227fd8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:18.033778 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7ccaecd4-b3ae-4248-a67a-f9cfb8227fd8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:18.038866 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-95004245-51af-4845-b3d5-b2cb4579fc72 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1672 microversion: 2.1 time: 0.187869 Jun 30 16:41:18.039430 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 469/962] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:17 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1672 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-7ccaecd4-b3ae-4248-a67a-f9cfb8227fd8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] HTTP exception thrown: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7ccaecd4-b3ae-4248-a67a-f9cfb8227fd8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Request method failure captured: Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 HTTP/1.1 Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdByCRmKHFn3MWHXG9FHLumdqoFbcitofz3WTo4vIsqDgEdQTbCYdYkG6VrKJfwKSwNBul_mR6Pq6q8wsCNMbsOQVU-vBawcL74Th9xNCcWYhdHHThpX8bYg_ks1_lfyxu2cd7ltcDmgXQzda0-vc83XxV9QJd6mMtTnGfzh1bTh8BQ Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:18.054520 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:18.056313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f942ab31bafc428bb1fba94aee2e0c32"}]}] Jun 30 16:41:18.056313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:18.056313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:18.056313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:18.056313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:18.056313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:18.056313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:18.056313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 0a26028451b345968fe86774f44736dd Jun 30 16:41:18.056313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:18.056313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:41:18.056313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:41:18.056313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'de05418a-11bf-401c-b0cb-52968e5d6d07'} Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:18.057108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. Jun 30 16:41:18.058435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:18.059728 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7ccaecd4-b3ae-4248-a67a-f9cfb8227fd8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Returning 404 to user: Instance de05418a-11bf-401c-b0cb-52968e5d6d07 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:18.059728 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7ccaecd4-b3ae-4248-a67a-f9cfb8227fd8 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07" status: 404 len: 111 microversion: 2.1 time: 0.031934 Jun 30 16:41:18.059728 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 494/963] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:18 2022] GET /compute/v2.1/servers/de05418a-11bf-401c-b0cb-52968e5d6d07 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:41:18.283321 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7ff944f6-5990-4a95-8ccb-d5a737dd48b4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:18.283968 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7ff944f6-5990-4a95-8ccb-d5a737dd48b4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:18.292743 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7ff944f6-5990-4a95-8ccb-d5a737dd48b4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:18.293420 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7ff944f6-5990-4a95-8ccb-d5a737dd48b4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:18.294268 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7ff944f6-5990-4a95-8ccb-d5a737dd48b4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:18.295205 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7ff944f6-5990-4a95-8ccb-d5a737dd48b4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:18.441401 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7ff944f6-5990-4a95-8ccb-d5a737dd48b4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:18.449341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7ff944f6-5990-4a95-8ccb-d5a737dd48b4 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1266 microversion: 2.1 time: 0.171753 Jun 30 16:41:18.449938 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 470/964] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:18 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:18.831423 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-7bc3dcca-0fd5-47cc-87cd-c1336553599d req-a056d952-db38-40d2-acdb-0c3289886626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa43141-bf18-4671-bcfe-fcc4b0b32da0", "name": "network-vif-deleted", "tag": "0a9fbc7b-f598-4597-8eb4-e0ab9c795a44"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:41:18.840370 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-7bc3dcca-0fd5-47cc-87cd-c1336553599d req-a056d952-db38-40d2-acdb-0c3289886626 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:18.840829 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-7bc3dcca-0fd5-47cc-87cd-c1336553599d req-a056d952-db38-40d2-acdb-0c3289886626 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:18.852464 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-7bc3dcca-0fd5-47cc-87cd-c1336553599d req-a056d952-db38-40d2-acdb-0c3289886626 service nova] Creating event network-vif-deleted:0a9fbc7b-f598-4597-8eb4-e0ab9c795a44 for instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 on hv-cinder-83602 Jun 30 16:41:18.857426 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-7bc3dcca-0fd5-47cc-87cd-c1336553599d req-a056d952-db38-40d2-acdb-0c3289886626 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029936 Jun 30 16:41:18.858060 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 495/965] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:19.063503 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-248be918-beec-49ef-b5fa-c59a1bafc510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:19.064226 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-248be918-beec-49ef-b5fa-c59a1bafc510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:19.073740 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-248be918-beec-49ef-b5fa-c59a1bafc510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:19.074406 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-248be918-beec-49ef-b5fa-c59a1bafc510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:19.075555 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-248be918-beec-49ef-b5fa-c59a1bafc510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:19.076272 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-248be918-beec-49ef-b5fa-c59a1bafc510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:19.144093 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-248be918-beec-49ef-b5fa-c59a1bafc510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:19.152291 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-248be918-beec-49ef-b5fa-c59a1bafc510 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1323 microversion: 2.1 time: 0.092685 Jun 30 16:41:19.152864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 471/966] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:19 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1323 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:19.376236 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-02214d78-94e8-40f5-9470-69b998f4d81b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:19.376821 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-02214d78-94e8-40f5-9470-69b998f4d81b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:19.383461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-02214d78-94e8-40f5-9470-69b998f4d81b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:19.384014 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-02214d78-94e8-40f5-9470-69b998f4d81b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:19.384811 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-02214d78-94e8-40f5-9470-69b998f4d81b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:19.385255 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-02214d78-94e8-40f5-9470-69b998f4d81b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:19.399383 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-02214d78-94e8-40f5-9470-69b998f4d81b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] HTTP exception thrown: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-02214d78-94e8-40f5-9470-69b998f4d81b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Request method failure captured: Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: DELETE /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 HTTP/1.1 Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdByCRmKHFn3MWHXG9FHLumdqoFbcitofz3WTo4vIsqDgEdQTbCYdYkG6VrKJfwKSwNBul_mR6Pq6q8wsCNMbsOQVU-vBawcL74Th9xNCcWYhdHHThpX8bYg_ks1_lfyxu2cd7ltcDmgXQzda0-vc83XxV9QJd6mMtTnGfzh1bTh8BQ Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:19.401113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:19.402512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f942ab31bafc428bb1fba94aee2e0c32"}]}] Jun 30 16:41:19.402512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:19.402512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:19.402512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:19.402512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:19.402512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:19.402512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:19.402512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 0a26028451b345968fe86774f44736dd Jun 30 16:41:19.402512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:19.402512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:41:19.402512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:41:19.402512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': '285f3262-38a1-4c65-9680-18fa2ef40c32'} Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:19.403232 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:41:19.404459 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:19.405643 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-02214d78-94e8-40f5-9470-69b998f4d81b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Returning 404 to user: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:19.405643 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-02214d78-94e8-40f5-9470-69b998f4d81b tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "DELETE /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 404 len: 111 microversion: 2.1 time: 0.031126 Jun 30 16:41:19.407375 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 496/967] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:41:19 2022] DELETE /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:41:19.413401 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e25b2553-b86b-4a2f-b737-2a0b6599cd43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:19.414291 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e25b2553-b86b-4a2f-b737-2a0b6599cd43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] [instance: 285f3262-38a1-4c65-9680-18fa2ef40c32] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:19.421747 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e25b2553-b86b-4a2f-b737-2a0b6599cd43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:19.422202 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e25b2553-b86b-4a2f-b737-2a0b6599cd43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:19.422975 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e25b2553-b86b-4a2f-b737-2a0b6599cd43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:19.423407 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e25b2553-b86b-4a2f-b737-2a0b6599cd43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:19.438150 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-e25b2553-b86b-4a2f-b737-2a0b6599cd43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] HTTP exception thrown: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e25b2553-b86b-4a2f-b737-2a0b6599cd43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Request method failure captured: Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 HTTP/1.1 Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdByCRmKHFn3MWHXG9FHLumdqoFbcitofz3WTo4vIsqDgEdQTbCYdYkG6VrKJfwKSwNBul_mR6Pq6q8wsCNMbsOQVU-vBawcL74Th9xNCcWYhdHHThpX8bYg_ks1_lfyxu2cd7ltcDmgXQzda0-vc83XxV9QJd6mMtTnGfzh1bTh8BQ Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:41:19.439722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:41:19.441841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_f942ab31bafc428bb1fba94aee2e0c32"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/f942ab31bafc428bb1fba94aee2e0c32"}]}] Jun 30 16:41:19.441841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:19.441841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: f942ab31bafc428bb1fba94aee2e0c32 Jun 30 16:41:19.441841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1707460953 Jun 30 16:41:19.441841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:19.441841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:41:19.441841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:41:19.441841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 0a26028451b345968fe86774f44736dd Jun 30 16:41:19.441841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-AttachVolumeNegativeTest-1707460953-project Jun 30 16:41:19.441841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:41:19.441841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:41:19.441841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': '285f3262-38a1-4c65-9680-18fa2ef40c32'} Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:19.442562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. Jun 30 16:41:19.443759 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:19.444837 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e25b2553-b86b-4a2f-b737-2a0b6599cd43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] Returning 404 to user: Instance 285f3262-38a1-4c65-9680-18fa2ef40c32 could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:19.444837 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e25b2553-b86b-4a2f-b737-2a0b6599cd43 tempest-AttachVolumeNegativeTest-1707460953 tempest-AttachVolumeNegativeTest-1707460953-project] 10.222.0.67 "GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32" status: 404 len: 111 microversion: 2.1 time: 0.032594 Jun 30 16:41:19.444837 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 472/968] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:19 2022] GET /compute/v2.1/servers/285f3262-38a1-4c65-9680-18fa2ef40c32 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:41:19.466230 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-21dd654a-f022-4f47-8d03-0c5a48a7921d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:19.467009 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-21dd654a-f022-4f47-8d03-0c5a48a7921d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:19.474048 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-21dd654a-f022-4f47-8d03-0c5a48a7921d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:19.474644 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-21dd654a-f022-4f47-8d03-0c5a48a7921d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:19.475580 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-21dd654a-f022-4f47-8d03-0c5a48a7921d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:19.476122 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-21dd654a-f022-4f47-8d03-0c5a48a7921d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:19.657930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-21dd654a-f022-4f47-8d03-0c5a48a7921d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:19.667486 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-21dd654a-f022-4f47-8d03-0c5a48a7921d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1266 microversion: 2.1 time: 0.205034 Jun 30 16:41:19.668378 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 497/969] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:19 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:20.171046 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-00b481de-b36d-4c72-9601-614625dfa889 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:20.171714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-00b481de-b36d-4c72-9601-614625dfa889 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:20.181473 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-00b481de-b36d-4c72-9601-614625dfa889 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:20.182347 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-00b481de-b36d-4c72-9601-614625dfa889 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:20.183871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-00b481de-b36d-4c72-9601-614625dfa889 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:20.184321 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-00b481de-b36d-4c72-9601-614625dfa889 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:20.221520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-00b481de-b36d-4c72-9601-614625dfa889 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:20.221983 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-00b481de-b36d-4c72-9601-614625dfa889 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:20.223103 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-00b481de-b36d-4c72-9601-614625dfa889 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lazy-loading 'fault' on Instance uuid cfa43141-bf18-4671-bcfe-fcc4b0b32da0 {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:41:20.267176 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-00b481de-b36d-4c72-9601-614625dfa889 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18f2856b1d3742a1aca89b4aeec0a3bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80a9bf240ed0447faaf33bec8f19cb70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:20.275609 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-00b481de-b36d-4c72-9601-614625dfa889 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 200 len: 1328 microversion: 2.1 time: 0.109266 Jun 30 16:41:20.276186 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 473/970] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:20 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 1328 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:20.683822 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b077779b-36ec-4eb7-bd13-0f04defeea2c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:20.684439 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b077779b-36ec-4eb7-bd13-0f04defeea2c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:20.692696 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b077779b-36ec-4eb7-bd13-0f04defeea2c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:20.693451 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b077779b-36ec-4eb7-bd13-0f04defeea2c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:20.694428 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b077779b-36ec-4eb7-bd13-0f04defeea2c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:20.694870 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b077779b-36ec-4eb7-bd13-0f04defeea2c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:20.736231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:41:20.894811 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b077779b-36ec-4eb7-bd13-0f04defeea2c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:20.904489 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b077779b-36ec-4eb7-bd13-0f04defeea2c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1453 microversion: 2.1 time: 0.224322 Jun 30 16:41:20.905255 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 498/971] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:20 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1453 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:20.924997 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-00075e6f-668e-447a-ae73-f9754f7dbc61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:20.926893 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-00075e6f-668e-447a-ae73-f9754f7dbc61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:20.934692 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-00075e6f-668e-447a-ae73-f9754f7dbc61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:20.939649 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-00075e6f-668e-447a-ae73-f9754f7dbc61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:20.939649 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-00075e6f-668e-447a-ae73-f9754f7dbc61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:20.939649 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-00075e6f-668e-447a-ae73-f9754f7dbc61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:21.089262 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-00075e6f-668e-447a-ae73-f9754f7dbc61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:21.098646 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-00075e6f-668e-447a-ae73-f9754f7dbc61 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1453 microversion: 2.1 time: 0.179931 Jun 30 16:41:21.099047 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 474/972] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:20 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:41:21.296381 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9c300c4f-cc0b-46bf-a11a-222b88a49abe tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:21.297438 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9c300c4f-cc0b-46bf-a11a-222b88a49abe tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:21.306769 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9c300c4f-cc0b-46bf-a11a-222b88a49abe tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:21.311174 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9c300c4f-cc0b-46bf-a11a-222b88a49abe tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:21.311174 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9c300c4f-cc0b-46bf-a11a-222b88a49abe tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:21.311174 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9c300c4f-cc0b-46bf-a11a-222b88a49abe tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:21.335719 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-9c300c4f-cc0b-46bf-a11a-222b88a49abe tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] HTTP exception thrown: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9c300c4f-cc0b-46bf-a11a-222b88a49abe tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Request method failure captured: Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 HTTP/1.1 Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdB4iD_JYyc3ecRZANBT8_ULN1BCIN6_XcwY-5HBg0w3c5VSpX-068BW-6WK7UMnIj_iCIfvKPm3kkVoY79lBXCRd3O556Sk_fL8UdIZEu_o6dfpZHT5pvIk_oy9S_DoEP52GzVOETOJtECSbVS0mzsXgJVbAeMwDApAwppOw1AzpQU Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: 80a9bf240ed0447faaf33bec8f19cb70 Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:21.338572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:21.341395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/80a9bf240ed0447faaf33bec8f19cb70"}]}] Jun 30 16:41:21.341395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:21.341395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: 80a9bf240ed0447faaf33bec8f19cb70 Jun 30 16:41:21.341395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:21.341395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeTestJSON-978962822-project Jun 30 16:41:21.341395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:21.341395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:21.341395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 18f2856b1d3742a1aca89b4aeec0a3bd Jun 30 16:41:21.341395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeTestJSON-978962822-project Jun 30 16:41:21.341395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:41:21.341395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:21.341395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'cfa43141-bf18-4671-bcfe-fcc4b0b32da0'} Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:21.342332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:21.343963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:21.345370 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9c300c4f-cc0b-46bf-a11a-222b88a49abe tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Returning 404 to user: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:21.345370 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9c300c4f-cc0b-46bf-a11a-222b88a49abe tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 404 len: 111 microversion: 2.1 time: 0.050517 Jun 30 16:41:21.348603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 499/973] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:21 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:41:21.352014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-718bed1f-2907-45a6-8a11-aad4372cf2a8 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '.version_select at 0x7f382012d160>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:21.434807 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-718bed1f-2907-45a6-8a11-aad4372cf2a8 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224866204" status: 202 len: 0 microversion: 2.1 time: 0.087612 Jun 30 16:41:21.435815 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 475/974] 10.222.0.67 () {58 vars in 1220 bytes} [Thu Jun 30 16:41:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1224866204 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:41:24.506961 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-fb7385c9-5ad1-40a1-89ee-c340bddae563 req-b5d22caf-d17e-42a8-a193-6fd6e359db6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b0e8c35-fb99-4b6f-9386-e1c2a73665cf", "tag": "9418a863-c50c-466a-a9fc-f7525b264d71"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:41:24.518133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-fb7385c9-5ad1-40a1-89ee-c340bddae563 req-b5d22caf-d17e-42a8-a193-6fd6e359db6d service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:24.518590 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-fb7385c9-5ad1-40a1-89ee-c340bddae563 req-b5d22caf-d17e-42a8-a193-6fd6e359db6d service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:24.530285 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-fb7385c9-5ad1-40a1-89ee-c340bddae563 req-b5d22caf-d17e-42a8-a193-6fd6e359db6d service nova] Creating event network-changed:9418a863-c50c-466a-a9fc-f7525b264d71 for instance 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf on hv-cinder-83602 Jun 30 16:41:24.539090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-fb7385c9-5ad1-40a1-89ee-c340bddae563 req-b5d22caf-d17e-42a8-a193-6fd6e359db6d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040173 Jun 30 16:41:24.539726 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 500/975] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:25.585760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6f71af6b-d6e1-4f20-a50e-71162193fa74 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:25.586481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6f71af6b-d6e1-4f20-a50e-71162193fa74 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:25.593432 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6f71af6b-d6e1-4f20-a50e-71162193fa74 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:25.593890 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6f71af6b-d6e1-4f20-a50e-71162193fa74 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:25.594674 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6f71af6b-d6e1-4f20-a50e-71162193fa74 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:25.595115 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6f71af6b-d6e1-4f20-a50e-71162193fa74 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:25.610475 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-6f71af6b-d6e1-4f20-a50e-71162193fa74 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] HTTP exception thrown: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6f71af6b-d6e1-4f20-a50e-71162193fa74 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Request method failure captured: Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: DELETE /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 HTTP/1.1 Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdB4iD_JYyc3ecRZANBT8_ULN1BCIN6_XcwY-5HBg0w3c5VSpX-068BW-6WK7UMnIj_iCIfvKPm3kkVoY79lBXCRd3O556Sk_fL8UdIZEu_o6dfpZHT5pvIk_oy9S_DoEP52GzVOETOJtECSbVS0mzsXgJVbAeMwDApAwppOw1AzpQU Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 80a9bf240ed0447faaf33bec8f19cb70 Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:41:25.612196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:41:25.614689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/80a9bf240ed0447faaf33bec8f19cb70"}]}] Jun 30 16:41:25.614689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:25.614689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 80a9bf240ed0447faaf33bec8f19cb70 Jun 30 16:41:25.614689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:25.614689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-AttachVolumeTestJSON-978962822-project Jun 30 16:41:25.614689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:41:25.614689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:41:25.614689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 18f2856b1d3742a1aca89b4aeec0a3bd Jun 30 16:41:25.614689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-AttachVolumeTestJSON-978962822-project Jun 30 16:41:25.614689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:41:25.614689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:25.614689 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': 'cfa43141-bf18-4671-bcfe-fcc4b0b32da0'} Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:25.615608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:25.617092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:25.618568 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6f71af6b-d6e1-4f20-a50e-71162193fa74 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Returning 404 to user: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:25.618568 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6f71af6b-d6e1-4f20-a50e-71162193fa74 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "DELETE /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 404 len: 111 microversion: 2.1 time: 0.033722 Jun 30 16:41:25.620688 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 476/976] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:41:25 2022] DELETE /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:41:25.625142 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-77edc272-41ff-4cf8-8564-000906b03477 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:25.625837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-77edc272-41ff-4cf8-8564-000906b03477 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: cfa43141-bf18-4671-bcfe-fcc4b0b32da0] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:25.633364 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-77edc272-41ff-4cf8-8564-000906b03477 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:25.633823 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-77edc272-41ff-4cf8-8564-000906b03477 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:25.634601 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-77edc272-41ff-4cf8-8564-000906b03477 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:25.635040 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-77edc272-41ff-4cf8-8564-000906b03477 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:25.650911 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-77edc272-41ff-4cf8-8564-000906b03477 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] HTTP exception thrown: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-77edc272-41ff-4cf8-8564-000906b03477 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Request method failure captured: Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 HTTP/1.1 Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdB4iD_JYyc3ecRZANBT8_ULN1BCIN6_XcwY-5HBg0w3c5VSpX-068BW-6WK7UMnIj_iCIfvKPm3kkVoY79lBXCRd3O556Sk_fL8UdIZEu_o6dfpZHT5pvIk_oy9S_DoEP52GzVOETOJtECSbVS0mzsXgJVbAeMwDApAwppOw1AzpQU Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: 80a9bf240ed0447faaf33bec8f19cb70 Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:25.653237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:25.655552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/80a9bf240ed0447faaf33bec8f19cb70"}]}] Jun 30 16:41:25.655552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:25.655552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: 80a9bf240ed0447faaf33bec8f19cb70 Jun 30 16:41:25.655552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:25.655552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeTestJSON-978962822-project Jun 30 16:41:25.655552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:25.655552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:25.655552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 18f2856b1d3742a1aca89b4aeec0a3bd Jun 30 16:41:25.655552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeTestJSON-978962822-project Jun 30 16:41:25.655552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:41:25.655552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:25.655552 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'cfa43141-bf18-4671-bcfe-fcc4b0b32da0'} Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:25.656385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. Jun 30 16:41:25.657738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:25.659367 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-77edc272-41ff-4cf8-8564-000906b03477 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Returning 404 to user: Instance cfa43141-bf18-4671-bcfe-fcc4b0b32da0 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:25.659367 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-77edc272-41ff-4cf8-8564-000906b03477 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0" status: 404 len: 111 microversion: 2.1 time: 0.033074 Jun 30 16:41:25.659367 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 501/977] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:25 2022] GET /compute/v2.1/servers/cfa43141-bf18-4671-bcfe-fcc4b0b32da0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:41:26.842806 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-b096a968-0c2d-4138-a803-81c5bbbf29ef tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] Action: 'create', calling method: .version_select at 0x7f3820162790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1021354017", "metadata": {"Type": "work"}}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:41:26.966708 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-78c8d703-da66-44f1-b58d-81ed1f105a36 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:26.967967 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-78c8d703-da66-44f1-b58d-81ed1f105a36 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:26.975783 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78c8d703-da66-44f1-b58d-81ed1f105a36 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:26.981477 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78c8d703-da66-44f1-b58d-81ed1f105a36 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:26.981477 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78c8d703-da66-44f1-b58d-81ed1f105a36 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:26.981477 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-78c8d703-da66-44f1-b58d-81ed1f105a36 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:26.992322 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-78c8d703-da66-44f1-b58d-81ed1f105a36 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] HTTP exception thrown: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-78c8d703-da66-44f1-b58d-81ed1f105a36 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Request method failure captured: Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: DELETE /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf HTTP/1.1 Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdB4iD_JYyc3ecRZANBT8_ULN1BCIN6_XcwY-5HBg0w3c5VSpX-068BW-6WK7UMnIj_iCIfvKPm3kkVoY79lBXCRd3O556Sk_fL8UdIZEu_o6dfpZHT5pvIk_oy9S_DoEP52GzVOETOJtECSbVS0mzsXgJVbAeMwDApAwppOw1AzpQU Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: 80a9bf240ed0447faaf33bec8f19cb70 Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:26.993920 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:26.995624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/80a9bf240ed0447faaf33bec8f19cb70"}]}] Jun 30 16:41:26.995624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:26.995624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: 80a9bf240ed0447faaf33bec8f19cb70 Jun 30 16:41:26.995624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:26.995624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeTestJSON-978962822-project Jun 30 16:41:26.995624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:26.995624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:26.995624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 18f2856b1d3742a1aca89b4aeec0a3bd Jun 30 16:41:26.995624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeTestJSON-978962822-project Jun 30 16:41:26.995624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:41:26.995624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:41:26.995624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': '32f21182-53c1-471e-b55f-3f5654e72daf'} Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:26.996453 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:41:26.997913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:26.999327 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-78c8d703-da66-44f1-b58d-81ed1f105a36 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Returning 404 to user: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:26.999327 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-78c8d703-da66-44f1-b58d-81ed1f105a36 tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "DELETE /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 404 len: 111 microversion: 2.1 time: 0.032521 Jun 30 16:41:26.999327 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 502/978] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:41:26 2022] DELETE /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 16:41:27.005157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6a808817-55cf-4354-a40d-9bb4406d03cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:27.005326 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6a808817-55cf-4354-a40d-9bb4406d03cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] [instance: 32f21182-53c1-471e-b55f-3f5654e72daf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:27.013917 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6a808817-55cf-4354-a40d-9bb4406d03cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:27.014366 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6a808817-55cf-4354-a40d-9bb4406d03cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:27.021738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6a808817-55cf-4354-a40d-9bb4406d03cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:27.021738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6a808817-55cf-4354-a40d-9bb4406d03cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:27.030242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-6a808817-55cf-4354-a40d-9bb4406d03cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] HTTP exception thrown: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6a808817-55cf-4354-a40d-9bb4406d03cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Request method failure captured: Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf HTTP/1.1 Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdB4iD_JYyc3ecRZANBT8_ULN1BCIN6_XcwY-5HBg0w3c5VSpX-068BW-6WK7UMnIj_iCIfvKPm3kkVoY79lBXCRd3O556Sk_fL8UdIZEu_o6dfpZHT5pvIk_oy9S_DoEP52GzVOETOJtECSbVS0mzsXgJVbAeMwDApAwppOw1AzpQU Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: 80a9bf240ed0447faaf33bec8f19cb70 Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:27.031930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:27.034260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_80a9bf240ed0447faaf33bec8f19cb70"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/80a9bf240ed0447faaf33bec8f19cb70"}]}] Jun 30 16:41:27.034260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:27.034260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: 80a9bf240ed0447faaf33bec8f19cb70 Jun 30 16:41:27.034260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeTestJSON-978962822 Jun 30 16:41:27.034260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeTestJSON-978962822-project Jun 30 16:41:27.034260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:27.034260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:27.034260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 18f2856b1d3742a1aca89b4aeec0a3bd Jun 30 16:41:27.034260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeTestJSON-978962822-project Jun 30 16:41:27.034260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:41:27.034260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:41:27.034260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': '32f21182-53c1-471e-b55f-3f5654e72daf'} Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:27.035135 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. Jun 30 16:41:27.037098 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:27.038492 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6a808817-55cf-4354-a40d-9bb4406d03cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] Returning 404 to user: Instance 32f21182-53c1-471e-b55f-3f5654e72daf could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:27.038492 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6a808817-55cf-4354-a40d-9bb4406d03cf tempest-AttachVolumeTestJSON-978962822 tempest-AttachVolumeTestJSON-978962822-project] 10.222.0.67 "GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf" status: 404 len: 111 microversion: 2.1 time: 0.033113 Jun 30 16:41:27.038492 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 503/979] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:41:26 2022] GET /compute/v2.1/servers/32f21182-53c1-471e-b55f-3f5654e72daf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 16:41:27.489913 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-b096a968-0c2d-4138-a803-81c5bbbf29ef tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.768693 Jun 30 16:41:27.490680 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 477/980] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Jun 30 16:41:26 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 770 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 30 16:41:27.502011 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e7b2f887-9733-4cd9-9876-ab1b58ad8f99 tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] Calling method '.version_select at 0x7f382026caf0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:27.555715 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e7b2f887-9733-4cd9-9876-ab1b58ad8f99 tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/eaf6c151-baa0-4e97-bf63-4f87d5789cc9" status: 200 len: 353 microversion: 2.1 time: 0.056731 Jun 30 16:41:27.556373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 504/981] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 30 16:41:27 2022] GET /compute/v2.1/os-volumes/eaf6c151-baa0-4e97-bf63-4f87d5789cc9 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:28.570422 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-226797e9-91a3-4a0c-858d-04ae57705725 tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] Calling method '.version_select at 0x7f3820133dc0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:28.618786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-226797e9-91a3-4a0c-858d-04ae57705725 tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/eaf6c151-baa0-4e97-bf63-4f87d5789cc9" status: 200 len: 354 microversion: 2.1 time: 0.053397 Jun 30 16:41:28.619357 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 478/982] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 30 16:41:28 2022] GET /compute/v2.1/os-volumes/eaf6c151-baa0-4e97-bf63-4f87d5789cc9 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:28.631507 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d38edc0d-7b49-46bd-9864-a062c6f202a6 tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] Calling method '.version_select at 0x7f3820292dc0>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:28.679172 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d38edc0d-7b49-46bd-9864-a062c6f202a6 tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/eaf6c151-baa0-4e97-bf63-4f87d5789cc9" status: 200 len: 354 microversion: 2.1 time: 0.052240 Jun 30 16:41:28.679707 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 505/983] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 30 16:41:28 2022] GET /compute/v2.1/os-volumes/eaf6c151-baa0-4e97-bf63-4f87d5789cc9 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:28.696658 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-18915ba6-66c5-4df8-a9ac-14a80f5c3b6e tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] Calling method '.version_select at 0x7f38201623a0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:28.982599 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-18915ba6-66c5-4df8-a9ac-14a80f5c3b6e tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/eaf6c151-baa0-4e97-bf63-4f87d5789cc9" status: 202 len: 0 microversion: 2.1 time: 0.289731 Jun 30 16:41:28.983166 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 479/984] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 30 16:41:28 2022] DELETE /compute/v2.1/os-volumes/eaf6c151-baa0-4e97-bf63-4f87d5789cc9 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:41:28.992928 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-76432d46-6b44-42a8-8e56-408b692572a1 tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] Calling method '.version_select at 0x7f3820251310>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:29.044128 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-76432d46-6b44-42a8-8e56-408b692572a1 tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/eaf6c151-baa0-4e97-bf63-4f87d5789cc9" status: 200 len: 353 microversion: 2.1 time: 0.056616 Jun 30 16:41:29.044874 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 506/985] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 30 16:41:28 2022] GET /compute/v2.1/os-volumes/eaf6c151-baa0-4e97-bf63-4f87d5789cc9 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:30.057731 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a5800f55-afba-4272-a373-775af7d0d04b tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] Calling method '.version_select at 0x7f382018aee0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:30.099834 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-a5800f55-afba-4272-a373-775af7d0d04b tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] HTTP exception thrown: Volume eaf6c151-baa0-4e97-bf63-4f87d5789cc9 could not be found. Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a5800f55-afba-4272-a373-775af7d0d04b tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] Request method failure captured: Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/os-volumes/eaf6c151-baa0-4e97-bf63-4f87d5789cc9 HTTP/1.1 Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdI2HJC_hvv3P6hm_hu4UknqCZ4XpQ-lj0KO0AtxOSG1auRwhG0BE9pI3lTtau7IJ-TRQcMgfZ7bufpDxiuUj6xL6k7KiOQxsr-jIwlaevPfdPRf-1-TPU9SNUCCnXAop8nSCBA66m2HB7G-Yno8XNCndnBowruFGx2FEOrTCjHx7tQ Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 561fc307f26d40b1a73b287ff89293f1 Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-VolumesGetTestJSON-2146876891 Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:41:30.101817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:41:30.103173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/561fc307f26d40b1a73b287ff89293f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/561fc307f26d40b1a73b287ff89293f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_561fc307f26d40b1a73b287ff89293f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/561fc307f26d40b1a73b287ff89293f1"}]}] Jun 30 16:41:30.103173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-VolumesGetTestJSON-2146876891 Jun 30 16:41:30.103173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 561fc307f26d40b1a73b287ff89293f1 Jun 30 16:41:30.103173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-VolumesGetTestJSON-2146876891 Jun 30 16:41:30.103173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-VolumesGetTestJSON-2146876891-project Jun 30 16:41:30.103173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:41:30.103173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:41:30.103173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 65fcedd910c6461d8d9a43efdef6154e Jun 30 16:41:30.103173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-VolumesGetTestJSON-2146876891-project Jun 30 16:41:30.103173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: Jun 30 16:41:30.103173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Volume eaf6c151-baa0-4e97-bf63-4f87d5789cc9 could not be found. Jun 30 16:41:30.103173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': 'eaf6c151-baa0-4e97-bf63-4f87d5789cc9'} Jun 30 16:41:30.103173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eaf6c151-baa0-4e97-bf63-4f87d5789cc9 could not be found. (HTTP 404) (Request-ID: req-816c9069-6a4b-45c6-9b72-245b98dd6f0f) Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:30.104542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:41:30.105853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eaf6c151-baa0-4e97-bf63-4f87d5789cc9 could not be found. Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 16:41:30.108965 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:30.110924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eaf6c151-baa0-4e97-bf63-4f87d5789cc9 could not be found. Jun 30 16:41:30.110924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:30.110924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:30.110924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:30.110924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:30.110924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:30.110924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:30.110924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:30.110924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:30.110924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eaf6c151-baa0-4e97-bf63-4f87d5789cc9 could not be found. Jun 30 16:41:30.110924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:30.110924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a5800f55-afba-4272-a373-775af7d0d04b tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] Returning 404 to user: Volume eaf6c151-baa0-4e97-bf63-4f87d5789cc9 could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:30.110924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a5800f55-afba-4272-a373-775af7d0d04b tempest-VolumesGetTestJSON-2146876891 tempest-VolumesGetTestJSON-2146876891-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/eaf6c151-baa0-4e97-bf63-4f87d5789cc9" status: 404 len: 109 microversion: 2.1 time: 0.050034 Jun 30 16:41:30.110924 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 480/986] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 30 16:41:30 2022] GET /compute/v2.1/os-volumes/eaf6c151-baa0-4e97-bf63-4f87d5789cc9 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:41:33.291555 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-501c8748-b4bf-45f9-ab4c-c312cef923a1 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Action: 'create', calling method: .version_select at 0x7f3820292940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-603361733", "metadata": {"Type": "work"}}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-501c8748-b4bf-45f9-ab4c-c312cef923a1 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Request method failure captured: Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 121 Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdI88iqt-nEvnsMtkbOhrEGnapbb-BJ3cs4IfejtSsHQC_KH56bkf_5tIbB9JgXoMUg6UCQP-zVX_nEs1b0rPSrqbDAeFJpY839OsYG2buoDS1IQmEPc6rx2IVp_C6OLxYthXSCLMDnNLzD3xUuuDhxFvUzQ8HxULDdsr83TolzmNwY Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: 4e825a3b75e24dab8e18fb5754654360 Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:33.311563 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:33.322076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4e825a3b75e24dab8e18fb5754654360"}]}] Jun 30 16:41:33.322076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.322076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: 4e825a3b75e24dab8e18fb5754654360 Jun 30 16:41:33.322076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.322076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-VolumesNegativeTest-715247262-project Jun 30 16:41:33.322076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:33.322076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:33.322076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: abe99ba29de64fc0b03b21823887e5b8 Jun 30 16:41:33.322076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-VolumesNegativeTest-715247262-project Jun 30 16:41:33.322076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Jun 30 16:41:33.322076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-603361733", "metadata": {"Type": "work"}}} Jun 30 16:41:33.322076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: Jun 30 16:41:33.322076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-603361733', 'metadata': {'Type': 'work'}}}} Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise error Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi '#$%' Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:33.323117 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 16:41:33.324771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 16:41:33.326207 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 30 16:41:33.326207 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.326207 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-501c8748-b4bf-45f9-ab4c-c312cef923a1 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:33.326207 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-501c8748-b4bf-45f9-ab4c-c312cef923a1 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.284147 Jun 30 16:41:33.326207 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 507/987] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Jun 30 16:41:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 285 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 16:41:33.331169 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e4a91fa7-abc9-48e0-84c7-6371bb458986 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Action: 'create', calling method: .version_select at 0x7f38202a49d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1462049189", "metadata": {"Type": "work"}}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e4a91fa7-abc9-48e0-84c7-6371bb458986 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Request method failure captured: Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 120 Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdI88iqt-nEvnsMtkbOhrEGnapbb-BJ3cs4IfejtSsHQC_KH56bkf_5tIbB9JgXoMUg6UCQP-zVX_nEs1b0rPSrqbDAeFJpY839OsYG2buoDS1IQmEPc6rx2IVp_C6OLxYthXSCLMDnNLzD3xUuuDhxFvUzQ8HxULDdsr83TolzmNwY Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 4e825a3b75e24dab8e18fb5754654360 Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:41:33.334455 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:41:33.335864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4e825a3b75e24dab8e18fb5754654360"}]}] Jun 30 16:41:33.335864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.335864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 4e825a3b75e24dab8e18fb5754654360 Jun 30 16:41:33.335864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.335864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-VolumesNegativeTest-715247262-project Jun 30 16:41:33.335864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:41:33.335864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:41:33.335864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: abe99ba29de64fc0b03b21823887e5b8 Jun 30 16:41:33.335864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-VolumesNegativeTest-715247262-project Jun 30 16:41:33.335864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Jun 30 16:41:33.335864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1462049189", "metadata": {"Type": "work"}}} Jun 30 16:41:33.335864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: Jun 30 16:41:33.335864 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1462049189', 'metadata': {'Type': 'work'}}}} Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise error Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi '0' Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:33.336672 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 16:41:33.338197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 16:41:33.340572 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 30 16:41:33.340572 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.340572 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e4a91fa7-abc9-48e0-84c7-6371bb458986 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:33.340572 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e4a91fa7-abc9-48e0-84c7-6371bb458986 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015830 Jun 30 16:41:33.340572 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 481/988] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Jun 30 16:41:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 16:41:33.346152 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-af7f77ca-c301-4985-9203-213a44692b19 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Action: 'create', calling method: .version_select at 0x7f38200f38b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1011246987", "metadata": {"Type": "work"}}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-af7f77ca-c301-4985-9203-213a44692b19 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Request method failure captured: Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 119 Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdI88iqt-nEvnsMtkbOhrEGnapbb-BJ3cs4IfejtSsHQC_KH56bkf_5tIbB9JgXoMUg6UCQP-zVX_nEs1b0rPSrqbDAeFJpY839OsYG2buoDS1IQmEPc6rx2IVp_C6OLxYthXSCLMDnNLzD3xUuuDhxFvUzQ8HxULDdsr83TolzmNwY Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: 4e825a3b75e24dab8e18fb5754654360 Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:33.349025 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:33.350818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4e825a3b75e24dab8e18fb5754654360"}]}] Jun 30 16:41:33.350818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.350818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: 4e825a3b75e24dab8e18fb5754654360 Jun 30 16:41:33.350818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.350818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-VolumesNegativeTest-715247262-project Jun 30 16:41:33.350818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:33.350818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:33.350818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: abe99ba29de64fc0b03b21823887e5b8 Jun 30 16:41:33.350818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-VolumesNegativeTest-715247262-project Jun 30 16:41:33.350818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Jun 30 16:41:33.350818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1011246987", "metadata": {"Type": "work"}}} Jun 30 16:41:33.350818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: Jun 30 16:41:33.350818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1011246987', 'metadata': {'Type': 'work'}}}} Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise error Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi '' Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:33.351941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 30 16:41:33.353361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 30 16:41:33.354569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 30 16:41:33.354569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.354569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-af7f77ca-c301-4985-9203-213a44692b19 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:33.354569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-af7f77ca-c301-4985-9203-213a44692b19 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008163 Jun 30 16:41:33.354569 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 508/989] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Jun 30 16:41:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 30 16:41:33.361289 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f45f0c74-9374-4cb3-8406-e1a3c567f898 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Calling method '.version_select at 0x7f3820133820>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:33.385026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8dfa436b-4299-42e4-aba4-f9a5799aeed1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:33.385996 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8dfa436b-4299-42e4-aba4-f9a5799aeed1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:33.390850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-f45f0c74-9374-4cb3-8406-e1a3c567f898 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] HTTP exception thrown: Volume tempest-invalid-884435934 could not be found. Jun 30 16:41:33.392434 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8dfa436b-4299-42e4-aba4-f9a5799aeed1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:33.392893 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8dfa436b-4299-42e4-aba4-f9a5799aeed1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f45f0c74-9374-4cb3-8406-e1a3c567f898 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Request method failure captured: Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-884435934 HTTP/1.1 Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdI88iqt-nEvnsMtkbOhrEGnapbb-BJ3cs4IfejtSsHQC_KH56bkf_5tIbB9JgXoMUg6UCQP-zVX_nEs1b0rPSrqbDAeFJpY839OsYG2buoDS1IQmEPc6rx2IVp_C6OLxYthXSCLMDnNLzD3xUuuDhxFvUzQ8HxULDdsr83TolzmNwY Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 4e825a3b75e24dab8e18fb5754654360 Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:41:33.393014 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:41:33.394523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4e825a3b75e24dab8e18fb5754654360"}]}] Jun 30 16:41:33.394523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.394523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 4e825a3b75e24dab8e18fb5754654360 Jun 30 16:41:33.394523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.394523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-VolumesNegativeTest-715247262-project Jun 30 16:41:33.394523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:41:33.394523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:41:33.394523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: abe99ba29de64fc0b03b21823887e5b8 Jun 30 16:41:33.394523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-VolumesNegativeTest-715247262-project Jun 30 16:41:33.394523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: Jun 30 16:41:33.394523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Volume tempest-invalid-884435934 could not be found. Jun 30 16:41:33.394523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': 'tempest-invalid-884435934'} Jun 30 16:41:33.394523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-884435934 could not be found. (HTTP 404) (Request-ID: req-d7c2beef-0772-4aa0-9460-a6c3a8ca2011) Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.396162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 16:41:33.397311 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-884435934 could not be found. Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:33.398408 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-884435934 could not be found. Jun 30 16:41:33.399665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.399665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.399665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.399665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.399665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:33.399665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:33.399665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:33.399665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:33.399665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-884435934 could not be found. Jun 30 16:41:33.399665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.399665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f45f0c74-9374-4cb3-8406-e1a3c567f898 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Returning 404 to user: Volume tempest-invalid-884435934 could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:33.400402 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8dfa436b-4299-42e4-aba4-f9a5799aeed1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:33.400402 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8dfa436b-4299-42e4-aba4-f9a5799aeed1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:33.400681 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f45f0c74-9374-4cb3-8406-e1a3c567f898 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-884435934" status: 404 len: 98 microversion: 2.1 time: 0.037695 Jun 30 16:41:33.400681 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 482/990] 10.222.0.67 () {58 vars in 1214 bytes} [Thu Jun 30 16:41:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-884435934 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 30 16:41:33.411685 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f7c48347-7362-495d-8dd1-3a47fa2d207d tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009204 Jun 30 16:41:33.411685 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 483/991] 10.222.0.67 () {58 vars in 1139 bytes} [Thu Jun 30 16:41:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 30 16:41:33.422049 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ef1c529e-c2b0-48e4-96f2-2f4b70b2b731 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004271 Jun 30 16:41:33.423296 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 484/992] 10.222.0.67 () {58 vars in 1136 bytes} [Thu Jun 30 16:41:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 30 16:41:33.428880 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8dfa436b-4299-42e4-aba4-f9a5799aeed1 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049464 Jun 30 16:41:33.429769 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 509/993] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Jun 30 16:41:33 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:41:33.434334 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8ff947f0-1c42-4c40-8a03-2e07d55c8e02 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Calling method '.version_select at 0x7f382018aee0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:33.480971 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-8ff947f0-1c42-4c40-8a03-2e07d55c8e02 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] HTTP exception thrown: Volume 668af01b-425f-4fff-a54b-d7adffaae409 could not be found. Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8ff947f0-1c42-4c40-8a03-2e07d55c8e02 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Request method failure captured: Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: DELETE /compute/v2.1/os-volumes/668af01b-425f-4fff-a54b-d7adffaae409 HTTP/1.1 Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdI88iqt-nEvnsMtkbOhrEGnapbb-BJ3cs4IfejtSsHQC_KH56bkf_5tIbB9JgXoMUg6UCQP-zVX_nEs1b0rPSrqbDAeFJpY839OsYG2buoDS1IQmEPc6rx2IVp_C6OLxYthXSCLMDnNLzD3xUuuDhxFvUzQ8HxULDdsr83TolzmNwY Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 4e825a3b75e24dab8e18fb5754654360 Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:41:33.482902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:41:33.484339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4e825a3b75e24dab8e18fb5754654360"}]}] Jun 30 16:41:33.484339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.484339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 4e825a3b75e24dab8e18fb5754654360 Jun 30 16:41:33.484339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.484339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-VolumesNegativeTest-715247262-project Jun 30 16:41:33.484339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:41:33.484339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:41:33.484339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: abe99ba29de64fc0b03b21823887e5b8 Jun 30 16:41:33.484339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-VolumesNegativeTest-715247262-project Jun 30 16:41:33.484339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: Jun 30 16:41:33.484339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Volume 668af01b-425f-4fff-a54b-d7adffaae409 could not be found. Jun 30 16:41:33.484339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': '668af01b-425f-4fff-a54b-d7adffaae409'} Jun 30 16:41:33.484339 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 668af01b-425f-4fff-a54b-d7adffaae409 could not be found. (HTTP 404) (Request-ID: req-435f7086-f4f3-4a44-85cc-37029e697674) Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.485124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 30 16:41:33.486284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 668af01b-425f-4fff-a54b-d7adffaae409 could not be found. Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 30 16:41:33.487435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:33.490902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 668af01b-425f-4fff-a54b-d7adffaae409 could not be found. Jun 30 16:41:33.490902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.490902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.490902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.490902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.490902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:33.490902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:33.490902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:33.490902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:33.490902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 668af01b-425f-4fff-a54b-d7adffaae409 could not be found. Jun 30 16:41:33.490902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.490902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8ff947f0-1c42-4c40-8a03-2e07d55c8e02 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Returning 404 to user: Volume 668af01b-425f-4fff-a54b-d7adffaae409 could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:33.490902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8ff947f0-1c42-4c40-8a03-2e07d55c8e02 tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/668af01b-425f-4fff-a54b-d7adffaae409" status: 404 len: 109 microversion: 2.1 time: 0.054024 Jun 30 16:41:33.490902 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 485/994] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 30 16:41:33 2022] DELETE /compute/v2.1/os-volumes/668af01b-425f-4fff-a54b-d7adffaae409 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 16:41:33.502107 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4e6686b3-1b8c-48ba-bb77-2a7ddba4900f tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Calling method '.version_select at 0x7f382026c550>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:33.503700 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e07a252e-fc48-43d2-9008-5dfdf3c6281c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:33.504248 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e07a252e-fc48-43d2-9008-5dfdf3c6281c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:33.511839 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e07a252e-fc48-43d2-9008-5dfdf3c6281c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:33.512432 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e07a252e-fc48-43d2-9008-5dfdf3c6281c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:33.513195 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e07a252e-fc48-43d2-9008-5dfdf3c6281c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:33.513681 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e07a252e-fc48-43d2-9008-5dfdf3c6281c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:33.536138 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-4e6686b3-1b8c-48ba-bb77-2a7ddba4900f tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] HTTP exception thrown: Volume 0e035933-19a1-4106-8982-a80e345689f0 could not be found. Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4e6686b3-1b8c-48ba-bb77-2a7ddba4900f tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Request method failure captured: Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/os-volumes/0e035933-19a1-4106-8982-a80e345689f0 HTTP/1.1 Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdI88iqt-nEvnsMtkbOhrEGnapbb-BJ3cs4IfejtSsHQC_KH56bkf_5tIbB9JgXoMUg6UCQP-zVX_nEs1b0rPSrqbDAeFJpY839OsYG2buoDS1IQmEPc6rx2IVp_C6OLxYthXSCLMDnNLzD3xUuuDhxFvUzQ8HxULDdsr83TolzmNwY Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: 4e825a3b75e24dab8e18fb5754654360 Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:33.539242 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:33.540930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_4e825a3b75e24dab8e18fb5754654360"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/4e825a3b75e24dab8e18fb5754654360"}]}] Jun 30 16:41:33.540930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.540930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: 4e825a3b75e24dab8e18fb5754654360 Jun 30 16:41:33.540930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-VolumesNegativeTest-715247262 Jun 30 16:41:33.540930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-VolumesNegativeTest-715247262-project Jun 30 16:41:33.540930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:33.540930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:33.540930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: abe99ba29de64fc0b03b21823887e5b8 Jun 30 16:41:33.540930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-VolumesNegativeTest-715247262-project Jun 30 16:41:33.540930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: Jun 30 16:41:33.540930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Volume 0e035933-19a1-4106-8982-a80e345689f0 could not be found. Jun 30 16:41:33.540930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': '0e035933-19a1-4106-8982-a80e345689f0'} Jun 30 16:41:33.540930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0e035933-19a1-4106-8982-a80e345689f0 could not be found. (HTTP 404) (Request-ID: req-e6b9a939-655e-4420-b7f1-4386fd7b129f) Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.541877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 30 16:41:33.543010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0e035933-19a1-4106-8982-a80e345689f0 could not be found. Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 30 16:41:33.544231 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:33.545361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0e035933-19a1-4106-8982-a80e345689f0 could not be found. Jun 30 16:41:33.545361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.545361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:33.545361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.545361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:33.545361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:33.545361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:33.545361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:33.545361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:33.545361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0e035933-19a1-4106-8982-a80e345689f0 could not be found. Jun 30 16:41:33.545361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:33.545361 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4e6686b3-1b8c-48ba-bb77-2a7ddba4900f tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] Returning 404 to user: Volume 0e035933-19a1-4106-8982-a80e345689f0 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:33.546131 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e07a252e-fc48-43d2-9008-5dfdf3c6281c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Going to try to terminate instance {{(pid=124814) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:41:33.546218 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-4e6686b3-1b8c-48ba-bb77-2a7ddba4900f tempest-VolumesNegativeTest-715247262 tempest-VolumesNegativeTest-715247262-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/0e035933-19a1-4106-8982-a80e345689f0" status: 404 len: 109 microversion: 2.1 time: 0.045099 Jun 30 16:41:33.546218 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 510/995] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 30 16:41:33 2022] GET /compute/v2.1/os-volumes/0e035933-19a1-4106-8982-a80e345689f0 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 16:41:33.942443 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e07a252e-fc48-43d2-9008-5dfdf3c6281c tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "DELETE /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 204 len: 0 microversion: 2.20 time: 0.442262 Jun 30 16:41:33.943686 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 486/996] 10.222.0.67 () {60 vars in 1279 bytes} [Thu Jun 30 16:41:33 2022] DELETE /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 30 16:41:33.951915 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ccec6677-075c-4a8b-94f6-05c0fcc59f21 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:33.952531 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ccec6677-075c-4a8b-94f6-05c0fcc59f21 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:33.955518 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:41:33.967787 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ccec6677-075c-4a8b-94f6-05c0fcc59f21 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:33.967944 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ccec6677-075c-4a8b-94f6-05c0fcc59f21 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:33.976020 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ccec6677-075c-4a8b-94f6-05c0fcc59f21 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:33.976020 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ccec6677-075c-4a8b-94f6-05c0fcc59f21 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:34.127963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ccec6677-075c-4a8b-94f6-05c0fcc59f21 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:34.138559 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ccec6677-075c-4a8b-94f6-05c0fcc59f21 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:34.140099 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ccec6677-075c-4a8b-94f6-05c0fcc59f21 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:34.141330 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ccec6677-075c-4a8b-94f6-05c0fcc59f21 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.193357 Jun 30 16:41:34.141874 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 511/997] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:41:33 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:41:35.161688 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-96dd3524-ae18-4974-9080-d0fd91ee4831 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:35.162916 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-96dd3524-ae18-4974-9080-d0fd91ee4831 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:35.169792 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-96dd3524-ae18-4974-9080-d0fd91ee4831 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:35.170246 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-96dd3524-ae18-4974-9080-d0fd91ee4831 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:35.171022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-96dd3524-ae18-4974-9080-d0fd91ee4831 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:35.171461 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-96dd3524-ae18-4974-9080-d0fd91ee4831 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:35.307624 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-96dd3524-ae18-4974-9080-d0fd91ee4831 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:35.316355 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-96dd3524-ae18-4974-9080-d0fd91ee4831 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:35.317857 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-96dd3524-ae18-4974-9080-d0fd91ee4831 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:35.319256 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-96dd3524-ae18-4974-9080-d0fd91ee4831 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.162396 Jun 30 16:41:35.319857 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 487/998] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:41:35 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 30 16:41:36.338733 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-66ff95f0-454f-449c-80dc-9a94e7665700 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:36.340113 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-66ff95f0-454f-449c-80dc-9a94e7665700 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:36.352632 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66ff95f0-454f-449c-80dc-9a94e7665700 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:36.353358 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66ff95f0-454f-449c-80dc-9a94e7665700 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:36.354317 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66ff95f0-454f-449c-80dc-9a94e7665700 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:36.354954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66ff95f0-454f-449c-80dc-9a94e7665700 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:36.507862 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-66ff95f0-454f-449c-80dc-9a94e7665700 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:36.515940 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-66ff95f0-454f-449c-80dc-9a94e7665700 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:36.517526 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-66ff95f0-454f-449c-80dc-9a94e7665700 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:36.518692 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-66ff95f0-454f-449c-80dc-9a94e7665700 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1723 microversion: 2.20 time: 0.184938 Jun 30 16:41:36.519238 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 512/999] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:41:36 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:41:37.010619 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-2d948e2f-9129-4859-b637-d2bf579272f7 req-f4bab85d-67e3-4bb1-810f-b1d91bd8bc17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50e41d57-839c-4b6e-8215-d67d1d428958", "name": "network-vif-deleted", "tag": "cef899ca-3465-4288-82e5-31385d9c468b"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:41:37.020688 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-2d948e2f-9129-4859-b637-d2bf579272f7 req-f4bab85d-67e3-4bb1-810f-b1d91bd8bc17 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:37.021763 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-2d948e2f-9129-4859-b637-d2bf579272f7 req-f4bab85d-67e3-4bb1-810f-b1d91bd8bc17 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:37.025764 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:41:37.036670 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-2d948e2f-9129-4859-b637-d2bf579272f7 req-f4bab85d-67e3-4bb1-810f-b1d91bd8bc17 service nova] Creating event network-vif-deleted:cef899ca-3465-4288-82e5-31385d9c468b for instance 50e41d57-839c-4b6e-8215-d67d1d428958 on hv-cinder-83602 Jun 30 16:41:37.042884 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-2d948e2f-9129-4859-b637-d2bf579272f7 req-f4bab85d-67e3-4bb1-810f-b1d91bd8bc17 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038381 Jun 30 16:41:37.043548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 488/1000] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:41:37.537391 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-71224b64-f6e8-4bf7-8e87-3387ac79f675 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:37.538038 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-71224b64-f6e8-4bf7-8e87-3387ac79f675 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:37.545054 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-71224b64-f6e8-4bf7-8e87-3387ac79f675 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:37.545511 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-71224b64-f6e8-4bf7-8e87-3387ac79f675 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:37.546295 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-71224b64-f6e8-4bf7-8e87-3387ac79f675 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:37.546739 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-71224b64-f6e8-4bf7-8e87-3387ac79f675 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:37.582492 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-71224b64-f6e8-4bf7-8e87-3387ac79f675 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:37.582947 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-71224b64-f6e8-4bf7-8e87-3387ac79f675 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:37.583407 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-71224b64-f6e8-4bf7-8e87-3387ac79f675 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lazy-loading 'fault' on Instance uuid 50e41d57-839c-4b6e-8215-d67d1d428958 {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:41:37.635932 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-71224b64-f6e8-4bf7-8e87-3387ac79f675 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:37.650468 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-71224b64-f6e8-4bf7-8e87-3387ac79f675 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:37.652052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-71224b64-f6e8-4bf7-8e87-3387ac79f675 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7261ab46436e4546b8331aa8387cfa1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66c389f8c5a47b2b97819e449c64ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:41:37.653498 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-71224b64-f6e8-4bf7-8e87-3387ac79f675 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 200 len: 1372 microversion: 2.20 time: 0.120369 Jun 30 16:41:37.654418 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 513/1001] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:41:37 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 1372 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 30 16:41:38.673998 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d49c6f58-0a56-415c-a3b7-6a00726d9dce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:38.674698 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d49c6f58-0a56-415c-a3b7-6a00726d9dce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:38.682167 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d49c6f58-0a56-415c-a3b7-6a00726d9dce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:38.682686 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d49c6f58-0a56-415c-a3b7-6a00726d9dce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:38.683500 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d49c6f58-0a56-415c-a3b7-6a00726d9dce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:38.683938 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d49c6f58-0a56-415c-a3b7-6a00726d9dce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:38.698739 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-d49c6f58-0a56-415c-a3b7-6a00726d9dce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] HTTP exception thrown: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d49c6f58-0a56-415c-a3b7-6a00726d9dce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Request method failure captured: Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 HTTP/1.1 Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdB6pKkSiFMb9j8N2I1bvvoImAeLsPz1K9QWyduTWRb-4VYgk1oINrSfuHlnizwWrxwJ4yObhLLv2Oge6HLhJsAE2K-oaNzIwWPf7oF0D4Qz-bz3DCeieqS4gc3uF_tPD28lmGbAitU35378iWLCG_ZaPFRDf3eptPMSN6bKHO9iWjM Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: b66c389f8c5a47b2b97819e449c64ba0 Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:41:38.700427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:41:38.702162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b66c389f8c5a47b2b97819e449c64ba0"}]}] Jun 30 16:41:38.702162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:38.702162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: b66c389f8c5a47b2b97819e449c64ba0 Jun 30 16:41:38.702162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:38.702162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-AttachVolumeShelveTestJSON-53036211-project Jun 30 16:41:38.702162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:41:38.702162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:41:38.702162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 7261ab46436e4546b8331aa8387cfa1c Jun 30 16:41:38.702162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-AttachVolumeShelveTestJSON-53036211-project Jun 30 16:41:38.702162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:41:38.702162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:38.702162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': '50e41d57-839c-4b6e-8215-d67d1d428958'} Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:38.703015 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:38.704745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:38.706021 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d49c6f58-0a56-415c-a3b7-6a00726d9dce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Returning 404 to user: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:38.706021 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d49c6f58-0a56-415c-a3b7-6a00726d9dce tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 404 len: 111 microversion: 2.20 time: 0.033121 Jun 30 16:41:38.706021 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 489/1002] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:41:38 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 16:41:38.711786 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-82e5aaa9-c1b3-46aa-a806-4d27e788c2db tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '.version_select at 0x7f3820251310>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:38.800307 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-82e5aaa9-c1b3-46aa-a806-4d27e788c2db tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629430661" status: 204 len: 0 microversion: 2.20 time: 0.093068 Jun 30 16:41:38.800890 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 514/1003] 10.222.0.67 () {60 vars in 1261 bytes} [Thu Jun 30 16:41:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1629430661 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 30 16:41:43.136348 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7b8d7844-d82e-43fc-bf58-780d1c66ad0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:43.137184 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7b8d7844-d82e-43fc-bf58-780d1c66ad0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:43.139359 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:41:43.145334 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b8d7844-d82e-43fc-bf58-780d1c66ad0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:43.145880 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b8d7844-d82e-43fc-bf58-780d1c66ad0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:43.146738 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b8d7844-d82e-43fc-bf58-780d1c66ad0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:43.147207 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b8d7844-d82e-43fc-bf58-780d1c66ad0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:43.165318 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-7b8d7844-d82e-43fc-bf58-780d1c66ad0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] HTTP exception thrown: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7b8d7844-d82e-43fc-bf58-780d1c66ad0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Request method failure captured: Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: DELETE /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 HTTP/1.1 Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdB6pKkSiFMb9j8N2I1bvvoImAeLsPz1K9QWyduTWRb-4VYgk1oINrSfuHlnizwWrxwJ4yObhLLv2Oge6HLhJsAE2K-oaNzIwWPf7oF0D4Qz-bz3DCeieqS4gc3uF_tPD28lmGbAitU35378iWLCG_ZaPFRDf3eptPMSN6bKHO9iWjM Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: b66c389f8c5a47b2b97819e449c64ba0 Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:41:43.166972 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:41:43.168526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b66c389f8c5a47b2b97819e449c64ba0"}]}] Jun 30 16:41:43.168526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:43.168526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: b66c389f8c5a47b2b97819e449c64ba0 Jun 30 16:41:43.168526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:43.168526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-AttachVolumeShelveTestJSON-53036211-project Jun 30 16:41:43.168526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:41:43.168526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:41:43.168526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 7261ab46436e4546b8331aa8387cfa1c Jun 30 16:41:43.168526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-AttachVolumeShelveTestJSON-53036211-project Jun 30 16:41:43.168526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:41:43.168526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:43.168526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': '50e41d57-839c-4b6e-8215-d67d1d428958'} Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:43.169586 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:43.171216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:43.173059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7b8d7844-d82e-43fc-bf58-780d1c66ad0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Returning 404 to user: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:43.173059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7b8d7844-d82e-43fc-bf58-780d1c66ad0f tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "DELETE /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 404 len: 111 microversion: 2.20 time: 0.038960 Jun 30 16:41:43.173059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 490/1004] 10.222.0.67 () {60 vars in 1279 bytes} [Thu Jun 30 16:41:43 2022] DELETE /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 16:41:43.179291 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f25d0252-1b2e-4713-8914-bf20bd3f4c3a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:43.180126 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f25d0252-1b2e-4713-8914-bf20bd3f4c3a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: 50e41d57-839c-4b6e-8215-d67d1d428958] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:43.192392 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f25d0252-1b2e-4713-8914-bf20bd3f4c3a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:43.192844 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f25d0252-1b2e-4713-8914-bf20bd3f4c3a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:43.193613 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f25d0252-1b2e-4713-8914-bf20bd3f4c3a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:43.194045 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f25d0252-1b2e-4713-8914-bf20bd3f4c3a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:43.209812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-f25d0252-1b2e-4713-8914-bf20bd3f4c3a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] HTTP exception thrown: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f25d0252-1b2e-4713-8914-bf20bd3f4c3a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Request method failure captured: Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 HTTP/1.1 Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdB6pKkSiFMb9j8N2I1bvvoImAeLsPz1K9QWyduTWRb-4VYgk1oINrSfuHlnizwWrxwJ4yObhLLv2Oge6HLhJsAE2K-oaNzIwWPf7oF0D4Qz-bz3DCeieqS4gc3uF_tPD28lmGbAitU35378iWLCG_ZaPFRDf3eptPMSN6bKHO9iWjM Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: b66c389f8c5a47b2b97819e449c64ba0 Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:43.212925 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:43.214373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b66c389f8c5a47b2b97819e449c64ba0"}]}] Jun 30 16:41:43.214373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:43.214373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: b66c389f8c5a47b2b97819e449c64ba0 Jun 30 16:41:43.214373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:43.214373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeShelveTestJSON-53036211-project Jun 30 16:41:43.214373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:43.214373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:43.214373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 7261ab46436e4546b8331aa8387cfa1c Jun 30 16:41:43.214373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeShelveTestJSON-53036211-project Jun 30 16:41:43.214373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:41:43.214373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:43.214373 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': '50e41d57-839c-4b6e-8215-d67d1d428958'} Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:43.215603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. Jun 30 16:41:43.224589 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:43.225918 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f25d0252-1b2e-4713-8914-bf20bd3f4c3a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Returning 404 to user: Instance 50e41d57-839c-4b6e-8215-d67d1d428958 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:43.225918 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f25d0252-1b2e-4713-8914-bf20bd3f4c3a tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958" status: 404 len: 111 microversion: 2.20 time: 0.041099 Jun 30 16:41:43.225918 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 515/1005] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:41:43 2022] GET /compute/v2.1/servers/50e41d57-839c-4b6e-8215-d67d1d428958 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 16:41:44.595007 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9ad0a9f0-876f-42e9-809b-05d21f612ac8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:44.595664 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9ad0a9f0-876f-42e9-809b-05d21f612ac8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:44.604426 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9ad0a9f0-876f-42e9-809b-05d21f612ac8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:44.604867 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9ad0a9f0-876f-42e9-809b-05d21f612ac8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:44.605640 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9ad0a9f0-876f-42e9-809b-05d21f612ac8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:44.606081 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9ad0a9f0-876f-42e9-809b-05d21f612ac8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:44.620450 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-9ad0a9f0-876f-42e9-809b-05d21f612ac8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] HTTP exception thrown: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9ad0a9f0-876f-42e9-809b-05d21f612ac8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Request method failure captured: Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: DELETE /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 HTTP/1.1 Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdB6pKkSiFMb9j8N2I1bvvoImAeLsPz1K9QWyduTWRb-4VYgk1oINrSfuHlnizwWrxwJ4yObhLLv2Oge6HLhJsAE2K-oaNzIwWPf7oF0D4Qz-bz3DCeieqS4gc3uF_tPD28lmGbAitU35378iWLCG_ZaPFRDf3eptPMSN6bKHO9iWjM Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: b66c389f8c5a47b2b97819e449c64ba0 Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:41:44.622059 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:41:44.623786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b66c389f8c5a47b2b97819e449c64ba0"}]}] Jun 30 16:41:44.623786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:44.623786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: b66c389f8c5a47b2b97819e449c64ba0 Jun 30 16:41:44.623786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:44.623786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-AttachVolumeShelveTestJSON-53036211-project Jun 30 16:41:44.623786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:41:44.623786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:41:44.623786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 7261ab46436e4546b8331aa8387cfa1c Jun 30 16:41:44.623786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-AttachVolumeShelveTestJSON-53036211-project Jun 30 16:41:44.623786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:41:44.623786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:41:44.623786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': 'ab1f1412-017f-448b-a6bb-21d09d668a46'} Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:44.624836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:41:44.626341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:41:44.627918 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9ad0a9f0-876f-42e9-809b-05d21f612ac8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Returning 404 to user: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:44.627918 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9ad0a9f0-876f-42e9-809b-05d21f612ac8 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 404 len: 111 microversion: 2.20 time: 0.033169 Jun 30 16:41:44.627918 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 491/1006] 10.222.0.67 () {60 vars in 1279 bytes} [Thu Jun 30 16:41:44 2022] DELETE /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 16:41:44.633537 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f02c4b25-c7ed-464a-80b7-891016ec3468 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:41:44.634262 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f02c4b25-c7ed-464a-80b7-891016ec3468 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] [instance: ab1f1412-017f-448b-a6bb-21d09d668a46] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:41:44.641084 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f02c4b25-c7ed-464a-80b7-891016ec3468 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:44.641611 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f02c4b25-c7ed-464a-80b7-891016ec3468 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:44.642336 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f02c4b25-c7ed-464a-80b7-891016ec3468 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:41:44.642763 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f02c4b25-c7ed-464a-80b7-891016ec3468 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:41:44.657349 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-f02c4b25-c7ed-464a-80b7-891016ec3468 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] HTTP exception thrown: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f02c4b25-c7ed-464a-80b7-891016ec3468 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Request method failure captured: Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 HTTP/1.1 Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdB6pKkSiFMb9j8N2I1bvvoImAeLsPz1K9QWyduTWRb-4VYgk1oINrSfuHlnizwWrxwJ4yObhLLv2Oge6HLhJsAE2K-oaNzIwWPf7oF0D4Qz-bz3DCeieqS4gc3uF_tPD28lmGbAitU35378iWLCG_ZaPFRDf3eptPMSN6bKHO9iWjM Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Openstack-Nova-Api-Version: 2.20 Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: b66c389f8c5a47b2b97819e449c64ba0 Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:41:44.658884 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:41:44.660568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b66c389f8c5a47b2b97819e449c64ba0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b66c389f8c5a47b2b97819e449c64ba0"}]}] Jun 30 16:41:44.660568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:44.660568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: b66c389f8c5a47b2b97819e449c64ba0 Jun 30 16:41:44.660568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-53036211 Jun 30 16:41:44.660568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-AttachVolumeShelveTestJSON-53036211-project Jun 30 16:41:44.660568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:41:44.660568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:41:44.660568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 7261ab46436e4546b8331aa8387cfa1c Jun 30 16:41:44.660568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-AttachVolumeShelveTestJSON-53036211-project Jun 30 16:41:44.660568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:41:44.660568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:41:44.660568 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'ab1f1412-017f-448b-a6bb-21d09d668a46'} Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:41:44.661622 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. Jun 30 16:41:44.663063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:41:44.665675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f02c4b25-c7ed-464a-80b7-891016ec3468 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] Returning 404 to user: Instance ab1f1412-017f-448b-a6bb-21d09d668a46 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:41:44.665675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f02c4b25-c7ed-464a-80b7-891016ec3468 tempest-AttachVolumeShelveTestJSON-53036211 tempest-AttachVolumeShelveTestJSON-53036211-project] 10.222.0.67 "GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46" status: 404 len: 111 microversion: 2.20 time: 0.031129 Jun 30 16:41:44.665675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 516/1007] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 30 16:41:44 2022] GET /compute/v2.1/servers/ab1f1412-017f-448b-a6bb-21d09d668a46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 30 16:42:23.287608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-274397937", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "networks": [{"uuid": "d9c21de2-16f4-4f3f-9d4d-665494393536"}]}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:42:23.294778 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=7 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:42:23.345967 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.network.neutron [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] validate_networks() for [('d9c21de2-16f4-4f3f-9d4d-665494393536', None, None, None, None, None)] {{(pid=124814) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:42:23.715404 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Flavor limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:42:23.715859 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Image limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:42:23.716366 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Flavor pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:42:23.716815 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Image pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:42:23.717231 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:42:23.727052 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:23.727520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:23.728331 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:23.728774 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:23.745431 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Getting quotas for project fc48c4912c8647d482593a28474d6b14. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:42:23.750145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Getting quotas for user f58941916ebe4a68a9a9a2b04b745ee2 and project fc48c4912c8647d482593a28474d6b14. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:42:23.761503 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Going to run 1 instances... {{(pid=124814) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:42:23.763817 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:42:23.890907 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3eab797d-382b-45b8-923a-3b25c9cf9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606437 Jun 30 16:42:23.891841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 492/1008] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:42:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 16:42:23.902315 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-eb0687c7-22b2-40a5-804a-51e9875175a6 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:23.907095 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-eb0687c7-22b2-40a5-804a-51e9875175a6 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:23.907095 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:42:23.907095 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=42 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:42:23.961342 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-eb0687c7-22b2-40a5-804a-51e9875175a6 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:23.968590 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-eb0687c7-22b2-40a5-804a-51e9875175a6 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1213 microversion: 2.1 time: 0.069760 Jun 30 16:42:23.969257 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 517/1009] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:23 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:24.993094 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a755392f-5e10-456f-a291-14f4e8ce66f4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:24.994312 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a755392f-5e10-456f-a291-14f4e8ce66f4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:25.073746 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a755392f-5e10-456f-a291-14f4e8ce66f4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:25.083525 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a755392f-5e10-456f-a291-14f4e8ce66f4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1213 microversion: 2.1 time: 0.101238 Jun 30 16:42:25.084108 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 493/1010] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:24 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:26.101717 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-66423d00-44e9-4f11-9b5e-96822f99edaf tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:26.102328 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-66423d00-44e9-4f11-9b5e-96822f99edaf tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:26.111422 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66423d00-44e9-4f11-9b5e-96822f99edaf tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:26.112116 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66423d00-44e9-4f11-9b5e-96822f99edaf tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:26.113080 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66423d00-44e9-4f11-9b5e-96822f99edaf tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:26.113676 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-66423d00-44e9-4f11-9b5e-96822f99edaf tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:26.222334 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-66423d00-44e9-4f11-9b5e-96822f99edaf tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:26.230940 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-66423d00-44e9-4f11-9b5e-96822f99edaf tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1265 microversion: 2.1 time: 0.134206 Jun 30 16:42:26.232138 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 518/1011] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:26 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1265 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:27.254219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0f1ac42e-2fa9-4414-a1ab-1c6c5a748233 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:27.254839 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0f1ac42e-2fa9-4414-a1ab-1c6c5a748233 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:27.262599 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0f1ac42e-2fa9-4414-a1ab-1c6c5a748233 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:27.263276 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0f1ac42e-2fa9-4414-a1ab-1c6c5a748233 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:27.265366 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0f1ac42e-2fa9-4414-a1ab-1c6c5a748233 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:27.266176 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0f1ac42e-2fa9-4414-a1ab-1c6c5a748233 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:27.536417 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0f1ac42e-2fa9-4414-a1ab-1c6c5a748233 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:27.545305 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0f1ac42e-2fa9-4414-a1ab-1c6c5a748233 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1313 microversion: 2.1 time: 0.296439 Jun 30 16:42:27.545991 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 494/1012] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:27 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:28.247031 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-d82f46aa-b484-4159-aef1-64690696574e req-68f38adf-0489-4494-b904-50a60e78f60a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5b5b090-631c-4a31-89a5-393056df1c5d", "tag": "b5174eb1-20a3-49fe-adbd-841f7b274334"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:42:28.257331 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-d82f46aa-b484-4159-aef1-64690696574e req-68f38adf-0489-4494-b904-50a60e78f60a service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:28.258079 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-d82f46aa-b484-4159-aef1-64690696574e req-68f38adf-0489-4494-b904-50a60e78f60a service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:28.271095 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-d82f46aa-b484-4159-aef1-64690696574e req-68f38adf-0489-4494-b904-50a60e78f60a service nova] Creating event network-changed:b5174eb1-20a3-49fe-adbd-841f7b274334 for instance c5b5b090-631c-4a31-89a5-393056df1c5d on hv-cinder-83602 Jun 30 16:42:28.276693 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-d82f46aa-b484-4159-aef1-64690696574e req-68f38adf-0489-4494-b904-50a60e78f60a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032934 Jun 30 16:42:28.277162 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 519/1013] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:42:28.563114 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ac23b077-ef31-4f80-b4d9-dd512d692831 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:28.564365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ac23b077-ef31-4f80-b4d9-dd512d692831 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:28.571826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ac23b077-ef31-4f80-b4d9-dd512d692831 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:28.572547 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ac23b077-ef31-4f80-b4d9-dd512d692831 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:28.573309 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ac23b077-ef31-4f80-b4d9-dd512d692831 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:28.573905 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ac23b077-ef31-4f80-b4d9-dd512d692831 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:28.855392 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ac23b077-ef31-4f80-b4d9-dd512d692831 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:28.868325 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ac23b077-ef31-4f80-b4d9-dd512d692831 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1313 microversion: 2.1 time: 0.306032 Jun 30 16:42:28.868325 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 495/1014] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:28 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:29.891684 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4b85144b-21a6-4045-b22e-5487b781a82c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:29.892608 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4b85144b-21a6-4045-b22e-5487b781a82c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:29.905881 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4b85144b-21a6-4045-b22e-5487b781a82c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:29.905881 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4b85144b-21a6-4045-b22e-5487b781a82c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:29.906913 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4b85144b-21a6-4045-b22e-5487b781a82c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:29.907408 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4b85144b-21a6-4045-b22e-5487b781a82c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:30.448615 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-4b85144b-21a6-4045-b22e-5487b781a82c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:30.456930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-4b85144b-21a6-4045-b22e-5487b781a82c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1313 microversion: 2.1 time: 0.579530 Jun 30 16:42:30.457504 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 520/1015] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:29 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:31.126391 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f35a14e5-c519-4f9d-8989-41b50746865b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:31.133063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-a566eec8-8b91-4eec-8d4b-c6cc4d9ee43b req-ed3cf11f-44e8-48f4-af8b-cafc413319cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68d4ed30-dc39-4be8-b345-360410abdc13", "tag": "ab01136b-ddb4-42c0-b8a6-880714395a42"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:42:31.137367 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f35a14e5-c519-4f9d-8989-41b50746865b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:31.142713 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-a566eec8-8b91-4eec-8d4b-c6cc4d9ee43b req-ed3cf11f-44e8-48f4-af8b-cafc413319cc service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:31.143164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-a566eec8-8b91-4eec-8d4b-c6cc4d9ee43b req-ed3cf11f-44e8-48f4-af8b-cafc413319cc service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:31.153557 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f35a14e5-c519-4f9d-8989-41b50746865b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:31.154027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f35a14e5-c519-4f9d-8989-41b50746865b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:31.155387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f35a14e5-c519-4f9d-8989-41b50746865b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:31.158283 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f35a14e5-c519-4f9d-8989-41b50746865b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:31.158532 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-a566eec8-8b91-4eec-8d4b-c6cc4d9ee43b req-ed3cf11f-44e8-48f4-af8b-cafc413319cc service nova] Creating event network-changed:ab01136b-ddb4-42c0-b8a6-880714395a42 for instance 68d4ed30-dc39-4be8-b345-360410abdc13 on hv-cinder-83602 Jun 30 16:42:31.164435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-a566eec8-8b91-4eec-8d4b-c6cc4d9ee43b req-ed3cf11f-44e8-48f4-af8b-cafc413319cc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035835 Jun 30 16:42:31.173279 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 521/1016] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:42:31.199100 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f35a14e5-c519-4f9d-8989-41b50746865b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Going to try to terminate instance {{(pid=124814) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:42:31.474234 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7dde1e8c-4a56-48f4-96f6-f633d235b423 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:31.474868 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-7dde1e8c-4a56-48f4-96f6-f633d235b423 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:31.492129 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7dde1e8c-4a56-48f4-96f6-f633d235b423 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:31.492655 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7dde1e8c-4a56-48f4-96f6-f633d235b423 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:31.493484 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7dde1e8c-4a56-48f4-96f6-f633d235b423 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:31.494024 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7dde1e8c-4a56-48f4-96f6-f633d235b423 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:31.544473 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f35a14e5-c519-4f9d-8989-41b50746865b tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "DELETE /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 204 len: 0 microversion: 2.1 time: 0.422845 Jun 30 16:42:31.545541 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 496/1017] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:42:31 2022] DELETE /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:42:31.567279 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8d430dde-69af-4441-8109-f3aa79c25a2f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:31.569183 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8d430dde-69af-4441-8109-f3aa79c25a2f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:31.578269 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d430dde-69af-4441-8109-f3aa79c25a2f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:31.579458 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d430dde-69af-4441-8109-f3aa79c25a2f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:31.580674 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d430dde-69af-4441-8109-f3aa79c25a2f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:31.581292 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d430dde-69af-4441-8109-f3aa79c25a2f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:31.794825 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-7dde1e8c-4a56-48f4-96f6-f633d235b423 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:31.808218 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7dde1e8c-4a56-48f4-96f6-f633d235b423 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1313 microversion: 2.1 time: 0.338180 Jun 30 16:42:31.809206 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 522/1018] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:31 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:31.850921 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8d430dde-69af-4441-8109-f3aa79c25a2f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:31.861917 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8d430dde-69af-4441-8109-f3aa79c25a2f tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1569 microversion: 2.1 time: 0.301486 Jun 30 16:42:31.866285 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 497/1019] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:31 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1569 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:42:32.833184 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9844e46e-b1ae-4d16-9d23-17291c1a2849 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:32.834829 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9844e46e-b1ae-4d16-9d23-17291c1a2849 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:32.854923 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9844e46e-b1ae-4d16-9d23-17291c1a2849 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:32.856524 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9844e46e-b1ae-4d16-9d23-17291c1a2849 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:32.858058 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9844e46e-b1ae-4d16-9d23-17291c1a2849 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:32.859440 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9844e46e-b1ae-4d16-9d23-17291c1a2849 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:32.890518 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6a907c02-5f7a-4e3a-9fdd-ce9fda7756b4 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:32.897537 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6a907c02-5f7a-4e3a-9fdd-ce9fda7756b4 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:32.908042 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6a907c02-5f7a-4e3a-9fdd-ce9fda7756b4 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:32.909572 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6a907c02-5f7a-4e3a-9fdd-ce9fda7756b4 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:32.912190 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6a907c02-5f7a-4e3a-9fdd-ce9fda7756b4 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:32.913850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6a907c02-5f7a-4e3a-9fdd-ce9fda7756b4 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:33.277716 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9844e46e-b1ae-4d16-9d23-17291c1a2849 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:33.294153 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9844e46e-b1ae-4d16-9d23-17291c1a2849 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1313 microversion: 2.1 time: 0.472389 Jun 30 16:42:33.294784 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 523/1020] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:32 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:33.400246 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6a907c02-5f7a-4e3a-9fdd-ce9fda7756b4 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:33.414510 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6a907c02-5f7a-4e3a-9fdd-ce9fda7756b4 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1569 microversion: 2.1 time: 0.535003 Jun 30 16:42:33.415100 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 498/1021] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:32 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1569 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:42:33.947671 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-fd14f4ad-c9ce-4695-bb41-e4db142725b8 req-4753c83e-55e2-47af-9d42-702ae5b1a4ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68d4ed30-dc39-4be8-b345-360410abdc13", "name": "network-vif-deleted", "tag": "ab01136b-ddb4-42c0-b8a6-880714395a42"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:42:33.963946 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-fd14f4ad-c9ce-4695-bb41-e4db142725b8 req-4753c83e-55e2-47af-9d42-702ae5b1a4ea service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:33.964736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-fd14f4ad-c9ce-4695-bb41-e4db142725b8 req-4753c83e-55e2-47af-9d42-702ae5b1a4ea service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:33.970564 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:42:33.979775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-fd14f4ad-c9ce-4695-bb41-e4db142725b8 req-4753c83e-55e2-47af-9d42-702ae5b1a4ea service nova] Creating event network-vif-deleted:ab01136b-ddb4-42c0-b8a6-880714395a42 for instance 68d4ed30-dc39-4be8-b345-360410abdc13 on hv-cinder-83602 Jun 30 16:42:33.986164 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-fd14f4ad-c9ce-4695-bb41-e4db142725b8 req-4753c83e-55e2-47af-9d42-702ae5b1a4ea service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042269 Jun 30 16:42:33.986977 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 524/1022] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:42:34.313374 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-661430b5-09d9-430c-b89d-a9c0993316f6 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:34.313993 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-661430b5-09d9-430c-b89d-a9c0993316f6 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:34.321752 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=2 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:42:34.325058 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-661430b5-09d9-430c-b89d-a9c0993316f6 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:34.325760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-661430b5-09d9-430c-b89d-a9c0993316f6 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:34.326881 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-661430b5-09d9-430c-b89d-a9c0993316f6 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:34.331230 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-661430b5-09d9-430c-b89d-a9c0993316f6 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:34.437962 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b8a19c86-ad8b-4bc6-955d-74e81fdfc714 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:34.439111 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b8a19c86-ad8b-4bc6-955d-74e81fdfc714 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:34.447530 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b8a19c86-ad8b-4bc6-955d-74e81fdfc714 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:34.448296 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b8a19c86-ad8b-4bc6-955d-74e81fdfc714 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:34.449439 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b8a19c86-ad8b-4bc6-955d-74e81fdfc714 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:34.450088 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b8a19c86-ad8b-4bc6-955d-74e81fdfc714 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:34.567508 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b8a19c86-ad8b-4bc6-955d-74e81fdfc714 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:34.583266 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b8a19c86-ad8b-4bc6-955d-74e81fdfc714 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1502 microversion: 2.1 time: 0.153436 Jun 30 16:42:34.584745 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 525/1023] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:34 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:42:34.612184 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-661430b5-09d9-430c-b89d-a9c0993316f6 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:34.620530 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-661430b5-09d9-430c-b89d-a9c0993316f6 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1313 microversion: 2.1 time: 0.313472 Jun 30 16:42:34.621505 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 499/1024] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:34 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:35.601160 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7c4b6d9d-191b-49da-9a75-07e3ecc8267a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:35.602055 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-7c4b6d9d-191b-49da-9a75-07e3ecc8267a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:35.610570 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7c4b6d9d-191b-49da-9a75-07e3ecc8267a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:35.611126 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7c4b6d9d-191b-49da-9a75-07e3ecc8267a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:35.612116 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7c4b6d9d-191b-49da-9a75-07e3ecc8267a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:35.612659 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7c4b6d9d-191b-49da-9a75-07e3ecc8267a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:35.639892 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8d3c031a-2c57-4f57-8990-7e7d2b681fb4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:35.645203 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8d3c031a-2c57-4f57-8990-7e7d2b681fb4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:35.646284 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=8 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:42:35.649173 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d3c031a-2c57-4f57-8990-7e7d2b681fb4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:35.649829 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d3c031a-2c57-4f57-8990-7e7d2b681fb4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:35.650821 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d3c031a-2c57-4f57-8990-7e7d2b681fb4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:35.651290 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8d3c031a-2c57-4f57-8990-7e7d2b681fb4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:35.706610 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-7c4b6d9d-191b-49da-9a75-07e3ecc8267a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:35.715547 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7c4b6d9d-191b-49da-9a75-07e3ecc8267a tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1502 microversion: 2.1 time: 0.118190 Jun 30 16:42:35.717548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 526/1025] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:35 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1502 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:35.896459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8d3c031a-2c57-4f57-8990-7e7d2b681fb4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:35.905165 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8d3c031a-2c57-4f57-8990-7e7d2b681fb4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1313 microversion: 2.1 time: 0.270071 Jun 30 16:42:35.914166 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 500/1026] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:35 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:42:36.653318 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-420517fa-d635-4cc8-9c06-cacb18e26a6c req-85d16e07-1beb-47f3-8f46-8fecc48d9057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b5b090-631c-4a31-89a5-393056df1c5d", "name": "network-vif-plugged", "status": "completed", "tag": "b5174eb1-20a3-49fe-adbd-841f7b274334"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:42:36.670345 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-420517fa-d635-4cc8-9c06-cacb18e26a6c req-85d16e07-1beb-47f3-8f46-8fecc48d9057 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:36.672721 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-420517fa-d635-4cc8-9c06-cacb18e26a6c req-85d16e07-1beb-47f3-8f46-8fecc48d9057 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:36.688811 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-420517fa-d635-4cc8-9c06-cacb18e26a6c req-85d16e07-1beb-47f3-8f46-8fecc48d9057 service nova] Creating event network-vif-plugged:b5174eb1-20a3-49fe-adbd-841f7b274334 for instance c5b5b090-631c-4a31-89a5-393056df1c5d on hv-cinder-83602 Jun 30 16:42:36.694550 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-420517fa-d635-4cc8-9c06-cacb18e26a6c req-85d16e07-1beb-47f3-8f46-8fecc48d9057 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044904 Jun 30 16:42:36.699219 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 527/1027] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:42:36.735928 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f6967326-0d85-4f88-a3a4-7204eba97872 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:36.739254 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f6967326-0d85-4f88-a3a4-7204eba97872 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:36.747610 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f6967326-0d85-4f88-a3a4-7204eba97872 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:36.748452 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f6967326-0d85-4f88-a3a4-7204eba97872 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:36.750982 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f6967326-0d85-4f88-a3a4-7204eba97872 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:36.751495 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f6967326-0d85-4f88-a3a4-7204eba97872 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:36.922985 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-50d36579-0d7a-44c4-b9b3-fd4178e36b81 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:36.924184 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-50d36579-0d7a-44c4-b9b3-fd4178e36b81 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:36.935917 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-50d36579-0d7a-44c4-b9b3-fd4178e36b81 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:36.938041 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-50d36579-0d7a-44c4-b9b3-fd4178e36b81 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:36.939079 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-50d36579-0d7a-44c4-b9b3-fd4178e36b81 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:36.941527 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-50d36579-0d7a-44c4-b9b3-fd4178e36b81 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:37.318712 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f6967326-0d85-4f88-a3a4-7204eba97872 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1a5d200007a4474a2a25d2ae0915c14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19b35fc495a345898167db62b9b95887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:37.336080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f6967326-0d85-4f88-a3a4-7204eba97872 tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 200 len: 1383 microversion: 2.1 time: 0.604815 Jun 30 16:42:37.336671 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 501/1028] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:36 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 1383 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:37.442266 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-50d36579-0d7a-44c4-b9b3-fd4178e36b81 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:37.453060 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-50d36579-0d7a-44c4-b9b3-fd4178e36b81 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1313 microversion: 2.1 time: 0.534142 Jun 30 16:42:37.454702 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 528/1029] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:36 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:42:38.353678 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3d0b08ce-09ba-4997-a89d-1ae0e74a2d4d tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:38.354302 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3d0b08ce-09ba-4997-a89d-1ae0e74a2d4d tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] [instance: 68d4ed30-dc39-4be8-b345-360410abdc13] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:38.362329 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3d0b08ce-09ba-4997-a89d-1ae0e74a2d4d tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:38.362781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3d0b08ce-09ba-4997-a89d-1ae0e74a2d4d tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:38.363600 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3d0b08ce-09ba-4997-a89d-1ae0e74a2d4d tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:38.364037 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3d0b08ce-09ba-4997-a89d-1ae0e74a2d4d tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:38.382064 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-3d0b08ce-09ba-4997-a89d-1ae0e74a2d4d tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] HTTP exception thrown: Instance 68d4ed30-dc39-4be8-b345-360410abdc13 could not be found. Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3d0b08ce-09ba-4997-a89d-1ae0e74a2d4d tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Request method failure captured: Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 HTTP/1.1 Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdEI5YzVtyDIVeXkstyTCWNmEPQEWwmzKJejQ9c6_7soIHiJ1nnQ78uVIoGrr9M2L5uzMqy2i0vmooD4JiMfEeRFEvyPUbtXKsSKWn_-GpAh38JKL343h6jl2RWZeQpRaUzutMC03quPtYMTdYzmsKB48jEZNr1smMlZTZ860SXBD_g Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 19b35fc495a345898167db62b9b95887 Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-TestShelveInstance-860964969 Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:42:38.385481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:42:38.387175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/19b35fc495a345898167db62b9b95887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/19b35fc495a345898167db62b9b95887"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_19b35fc495a345898167db62b9b95887"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/19b35fc495a345898167db62b9b95887"}]}] Jun 30 16:42:38.387175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-TestShelveInstance-860964969 Jun 30 16:42:38.387175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 19b35fc495a345898167db62b9b95887 Jun 30 16:42:38.387175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-TestShelveInstance-860964969 Jun 30 16:42:38.387175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-TestShelveInstance-860964969-project Jun 30 16:42:38.387175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:42:38.387175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:42:38.387175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: b1a5d200007a4474a2a25d2ae0915c14 Jun 30 16:42:38.387175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-TestShelveInstance-860964969-project Jun 30 16:42:38.387175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:42:38.387175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance 68d4ed30-dc39-4be8-b345-360410abdc13 could not be found. Jun 30 16:42:38.387175 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': '68d4ed30-dc39-4be8-b345-360410abdc13'} Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68d4ed30-dc39-4be8-b345-360410abdc13 could not be found. Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:42:38.388080 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68d4ed30-dc39-4be8-b345-360410abdc13 could not be found. Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68d4ed30-dc39-4be8-b345-360410abdc13 could not be found. Jun 30 16:42:38.389536 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:42:38.394545 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3d0b08ce-09ba-4997-a89d-1ae0e74a2d4d tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Returning 404 to user: Instance 68d4ed30-dc39-4be8-b345-360410abdc13 could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:42:38.394545 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3d0b08ce-09ba-4997-a89d-1ae0e74a2d4d tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13" status: 404 len: 111 microversion: 2.1 time: 0.037227 Jun 30 16:42:38.394545 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 502/1030] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:38 2022] GET /compute/v2.1/servers/68d4ed30-dc39-4be8-b345-360410abdc13 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 16:42:38.469627 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a531ac65-75f2-4943-a477-7c5dc3127811 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:38.470259 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a531ac65-75f2-4943-a477-7c5dc3127811 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:38.479623 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a531ac65-75f2-4943-a477-7c5dc3127811 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:38.480083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a531ac65-75f2-4943-a477-7c5dc3127811 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:38.484929 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a531ac65-75f2-4943-a477-7c5dc3127811 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:38.485636 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a531ac65-75f2-4943-a477-7c5dc3127811 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:38.715310 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-a531ac65-75f2-4943-a477-7c5dc3127811 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:38.724512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a531ac65-75f2-4943-a477-7c5dc3127811 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1313 microversion: 2.1 time: 0.258798 Jun 30 16:42:38.737648 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 529/1031] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:38 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:38.846431 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5f4aea58-20b5-4a72-a3d1-7f89e6c794bd tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] Calling method '.version_select at 0x7f3820081ee0>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:38.994033 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5f4aea58-20b5-4a72-a3d1-7f89e6c794bd tempest-TestShelveInstance-860964969 tempest-TestShelveInstance-860964969-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1708708675" status: 202 len: 0 microversion: 2.1 time: 0.152912 Jun 30 16:42:38.994953 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 503/1032] 10.222.0.67 () {58 vars in 1253 bytes} [Thu Jun 30 16:42:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1708708675 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:42:39.742142 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f79981f7-196b-4b5f-8d38-2f0c482d3a40 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:39.742894 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f79981f7-196b-4b5f-8d38-2f0c482d3a40 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:39.749530 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f79981f7-196b-4b5f-8d38-2f0c482d3a40 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:39.749987 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f79981f7-196b-4b5f-8d38-2f0c482d3a40 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:39.750762 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f79981f7-196b-4b5f-8d38-2f0c482d3a40 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:39.751198 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f79981f7-196b-4b5f-8d38-2f0c482d3a40 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:39.991943 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f79981f7-196b-4b5f-8d38-2f0c482d3a40 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:40.000122 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f79981f7-196b-4b5f-8d38-2f0c482d3a40 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1496 microversion: 2.1 time: 0.261869 Jun 30 16:42:40.011576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 530/1033] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:39 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1496 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:40.892744 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a3609e20-a722-4eb8-993a-5a63ab50cbf0 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:40.893947 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a3609e20-a722-4eb8-993a-5a63ab50cbf0 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:40.907266 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a3609e20-a722-4eb8-993a-5a63ab50cbf0 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:40.907756 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a3609e20-a722-4eb8-993a-5a63ab50cbf0 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:40.909260 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a3609e20-a722-4eb8-993a-5a63ab50cbf0 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:40.909735 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a3609e20-a722-4eb8-993a-5a63ab50cbf0 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:40.952010 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a3609e20-a722-4eb8-993a-5a63ab50cbf0 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Going to try to terminate instance {{(pid=124814) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:42:41.341618 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a3609e20-a722-4eb8-993a-5a63ab50cbf0 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 204 len: 0 microversion: 2.1 time: 0.452555 Jun 30 16:42:41.342485 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 504/1034] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:42:40 2022] DELETE /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:42:41.351500 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-3e238a8d-f9ec-47fa-9c67-d5ed0e5ee9c4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:41.352689 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-3e238a8d-f9ec-47fa-9c67-d5ed0e5ee9c4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:41.362712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3e238a8d-f9ec-47fa-9c67-d5ed0e5ee9c4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:41.365100 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3e238a8d-f9ec-47fa-9c67-d5ed0e5ee9c4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:41.365897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3e238a8d-f9ec-47fa-9c67-d5ed0e5ee9c4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:41.366338 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-3e238a8d-f9ec-47fa-9c67-d5ed0e5ee9c4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:41.606708 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-3e238a8d-f9ec-47fa-9c67-d5ed0e5ee9c4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:41.620824 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-3e238a8d-f9ec-47fa-9c67-d5ed0e5ee9c4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1502 microversion: 2.1 time: 0.272946 Jun 30 16:42:41.625131 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 531/1035] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:41 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1502 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:42.643994 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0c67c5be-45d3-4617-b6a2-54c7fc5b6168 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:42.645736 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0c67c5be-45d3-4617-b6a2-54c7fc5b6168 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:42.660744 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0c67c5be-45d3-4617-b6a2-54c7fc5b6168 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:42.661415 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0c67c5be-45d3-4617-b6a2-54c7fc5b6168 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:42.662638 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0c67c5be-45d3-4617-b6a2-54c7fc5b6168 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:42.663341 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0c67c5be-45d3-4617-b6a2-54c7fc5b6168 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:43.012348 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0c67c5be-45d3-4617-b6a2-54c7fc5b6168 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:43.022057 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0c67c5be-45d3-4617-b6a2-54c7fc5b6168 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1502 microversion: 2.1 time: 0.385130 Jun 30 16:42:43.022990 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 505/1036] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:42 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1502 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:44.005516 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-cdb01cff-b7d7-42f7-84a5-e2275039444c req-52ae20e8-2699-4ec7-bd09-307e10bbaf36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5b5b090-631c-4a31-89a5-393056df1c5d", "name": "network-vif-deleted", "tag": "b5174eb1-20a3-49fe-adbd-841f7b274334"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:42:44.019161 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-cdb01cff-b7d7-42f7-84a5-e2275039444c req-52ae20e8-2699-4ec7-bd09-307e10bbaf36 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:44.019751 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-cdb01cff-b7d7-42f7-84a5-e2275039444c req-52ae20e8-2699-4ec7-bd09-307e10bbaf36 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:44.039725 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-062b1813-df54-4206-8945-d77c11970f4e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:44.040611 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-062b1813-df54-4206-8945-d77c11970f4e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:44.059279 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-cdb01cff-b7d7-42f7-84a5-e2275039444c req-52ae20e8-2699-4ec7-bd09-307e10bbaf36 service nova] Creating event network-vif-deleted:b5174eb1-20a3-49fe-adbd-841f7b274334 for instance c5b5b090-631c-4a31-89a5-393056df1c5d on hv-cinder-83602 Jun 30 16:42:44.063956 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-062b1813-df54-4206-8945-d77c11970f4e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:44.068712 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-062b1813-df54-4206-8945-d77c11970f4e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:44.069577 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-062b1813-df54-4206-8945-d77c11970f4e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:44.070064 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-062b1813-df54-4206-8945-d77c11970f4e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:44.079835 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-cdb01cff-b7d7-42f7-84a5-e2275039444c req-52ae20e8-2699-4ec7-bd09-307e10bbaf36 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087032 Jun 30 16:42:44.087761 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 532/1037] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:42:44.264591 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-062b1813-df54-4206-8945-d77c11970f4e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:44.274723 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-062b1813-df54-4206-8945-d77c11970f4e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 200 len: 1460 microversion: 2.1 time: 0.238930 Jun 30 16:42:44.281041 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 506/1038] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:44 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 1460 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:42:45.301836 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-73aaa0cc-5f7a-4b6e-a17d-633300922b8e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:45.302500 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-73aaa0cc-5f7a-4b6e-a17d-633300922b8e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: c5b5b090-631c-4a31-89a5-393056df1c5d] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:45.309318 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-73aaa0cc-5f7a-4b6e-a17d-633300922b8e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:45.310082 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-73aaa0cc-5f7a-4b6e-a17d-633300922b8e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:45.311056 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-73aaa0cc-5f7a-4b6e-a17d-633300922b8e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:45.311762 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-73aaa0cc-5f7a-4b6e-a17d-633300922b8e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:45.329841 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-73aaa0cc-5f7a-4b6e-a17d-633300922b8e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] HTTP exception thrown: Instance c5b5b090-631c-4a31-89a5-393056df1c5d could not be found. Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-73aaa0cc-5f7a-4b6e-a17d-633300922b8e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Request method failure captured: Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d HTTP/1.1 Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdJtyouNpEdaVnAdUlJ5I2iGmYe_oiybbUpKnYx2GhbgKF-0BWCVWv0XLVq6JsDw7-ic9Gk_4LWdwD7OjSTjAM1r1pzjl329psgFMer7AyRXSZjxwqEhVQY-go03rDMDp61PpBKQCeCp3OBjK8bN1zP8b52NnfqTjeJ5GRT06E7KDVs Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: fc48c4912c8647d482593a28474d6b14 Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-VolumesActionsTest-2040525805 Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:42:45.331548 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:42:45.333155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fc48c4912c8647d482593a28474d6b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fc48c4912c8647d482593a28474d6b14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fc48c4912c8647d482593a28474d6b14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fc48c4912c8647d482593a28474d6b14"}]}] Jun 30 16:42:45.333155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-VolumesActionsTest-2040525805 Jun 30 16:42:45.333155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: fc48c4912c8647d482593a28474d6b14 Jun 30 16:42:45.333155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-VolumesActionsTest-2040525805 Jun 30 16:42:45.333155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-VolumesActionsTest-2040525805-project Jun 30 16:42:45.333155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:42:45.333155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:42:45.333155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: f58941916ebe4a68a9a9a2b04b745ee2 Jun 30 16:42:45.333155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-VolumesActionsTest-2040525805-project Jun 30 16:42:45.333155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:42:45.333155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance c5b5b090-631c-4a31-89a5-393056df1c5d could not be found. Jun 30 16:42:45.333155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'c5b5b090-631c-4a31-89a5-393056df1c5d'} Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5b5b090-631c-4a31-89a5-393056df1c5d could not be found. Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:42:45.334157 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5b5b090-631c-4a31-89a5-393056df1c5d could not be found. Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5b5b090-631c-4a31-89a5-393056df1c5d could not be found. Jun 30 16:42:45.335606 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:42:45.337827 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-73aaa0cc-5f7a-4b6e-a17d-633300922b8e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Returning 404 to user: Instance c5b5b090-631c-4a31-89a5-393056df1c5d could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:42:45.338844 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-73aaa0cc-5f7a-4b6e-a17d-633300922b8e tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d" status: 404 len: 111 microversion: 2.1 time: 0.043510 Jun 30 16:42:45.340078 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 533/1039] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:45 2022] GET /compute/v2.1/servers/c5b5b090-631c-4a31-89a5-393056df1c5d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:42:45.485302 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-450432274", "imageRef": "0ff4dd06-5f1e-44b3-8340-8a6706a988e6", "flavorRef": "452", "networks": [{"uuid": "d9c21de2-16f4-4f3f-9d4d-665494393536"}]}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:42:52.863390 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.network.neutron [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] validate_networks() for [('d9c21de2-16f4-4f3f-9d4d-665494393536', None, None, None, None, None)] {{(pid=124814) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:42:53.595838 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Flavor limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:42:53.596243 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Image limits 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:42:53.596783 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Flavor pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:42:53.597265 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Image pref 0:0:0 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:42:53.597836 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.virt.hardware [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124814) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:42:53.607753 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:53.608206 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:53.609344 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:53.609804 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:53.629296 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Getting quotas for project fc48c4912c8647d482593a28474d6b14. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:42:53.633376 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Getting quotas for user f58941916ebe4a68a9a9a2b04b745ee2 and project fc48c4912c8647d482593a28474d6b14. Resources: {'instances', 'ram', 'cores'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:42:53.645203 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Going to run 1 instances... {{(pid=124814) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:42:53.647496 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0ff4dd06-5f1e-44b3-8340-8a6706a988e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124814) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:42:53.882761 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-05a2ad04-9bc4-4ba5-a842-34f17f032847 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.402328 Jun 30 16:42:53.895235 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 507/1040] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:42:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 8416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 16:42:53.898147 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9bcb54ae-1d6e-4475-a016-556d55d4e5f3 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:53.898147 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9bcb54ae-1d6e-4475-a016-556d55d4e5f3 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:53.962254 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9bcb54ae-1d6e-4475-a016-556d55d4e5f3 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:53.970588 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9bcb54ae-1d6e-4475-a016-556d55d4e5f3 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1213 microversion: 2.1 time: 0.079743 Jun 30 16:42:53.983186 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 534/1041] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:53 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:54.048155 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-63e7fb6f-e6ee-4906-86ca-9adb093d6868 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Action: 'create', calling method: .version_select at 0x7f3820181820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1902677105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/CoeVmmjRvQQ3RzzNBeCxOfbBPrOzXeatBV1hfdSUEO1rh3gL1I4cwTN/2gwimAqndzznIODmRVBzYqS5TcQIBnqxP32LNZ2TxQQBnkBZOMkh+KFyVxAk8o/boBEEFRA=="}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:42:54.052472 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:42:54.065260 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-63e7fb6f-e6ee-4906-86ca-9adb093d6868 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Getting quotas for project ce9b910eae974562929f660ba8c7af4c. Resources: {'key_pairs'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:42:54.069553 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.quota [None req-63e7fb6f-e6ee-4906-86ca-9adb093d6868 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Getting quotas for user 9c4e7816dc9c4eeab652534160c22757 and project ce9b910eae974562929f660ba8c7af4c. Resources: {'key_pairs'} {{(pid=124814) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:42:54.193444 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-63e7fb6f-e6ee-4906-86ca-9adb093d6868 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.149237 Jun 30 16:42:54.194326 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 508/1042] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 30 16:42:54 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:42:54.369617 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-329903098", "imageRef": "fa3c2007-4853-4d3d-9a94-ec0460b603fd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1902677105", "networks": [{"uuid": "432368ea-cf2c-480c-9e0a-66cefd6e1974"}]}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:42:54.421786 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.network.neutron [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] validate_networks() for [('432368ea-cf2c-480c-9e0a-66cefd6e1974', None, None, None, None, None)] {{(pid=124815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:42:54.810313 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Flavor limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:42:54.810740 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Image limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:42:54.811220 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Flavor pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:42:54.811678 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Image pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:42:54.812096 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:42:54.823973 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:54.824430 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:54.825237 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:54.825686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:54.842993 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Getting quotas for project ce9b910eae974562929f660ba8c7af4c. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:42:54.847676 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Getting quotas for user 9c4e7816dc9c4eeab652534160c22757 and project ce9b910eae974562929f660ba8c7af4c. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:42:54.858990 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Going to run 1 instances... {{(pid=124815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:42:54.861468 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fa3c2007-4853-4d3d-9a94-ec0460b603fd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:42:54.983269 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [4f8e9d7b-2d6e-43e2-8fdc-3db859cc7210] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 16:42:54.989317 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d3d2cbf8-16a7-4993-bc35-90c54827eab4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:54.989938 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d3d2cbf8-16a7-4993-bc35-90c54827eab4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:54.997548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d3d2cbf8-16a7-4993-bc35-90c54827eab4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:54.998000 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d3d2cbf8-16a7-4993-bc35-90c54827eab4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:54.998779 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d3d2cbf8-16a7-4993-bc35-90c54827eab4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:54.999220 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d3d2cbf8-16a7-4993-bc35-90c54827eab4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:55.002952 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:42:55.065979 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d3d2cbf8-16a7-4993-bc35-90c54827eab4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:55.074139 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d3d2cbf8-16a7-4993-bc35-90c54827eab4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1217 microversion: 2.1 time: 0.089475 Jun 30 16:42:55.074712 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 509/1043] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:54 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:55.992327 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO oslo.messaging._drivers.impl_rabbit [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [4f8e9d7b-2d6e-43e2-8fdc-3db859cc7210] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 45402. Jun 30 16:42:55.997175 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9f71cc04-c9cb-4627-b69d-b15a2875a6b2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.631514 Jun 30 16:42:56.002208 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 535/1044] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:42:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 30 16:42:56.012837 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1cef189d-4b5a-4ad6-b862-944d6b475e95 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:56.013714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-1cef189d-4b5a-4ad6-b862-944d6b475e95 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:56.075758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-1cef189d-4b5a-4ad6-b862-944d6b475e95 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:56.084868 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-1cef189d-4b5a-4ad6-b862-944d6b475e95 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1258 microversion: 2.1 time: 0.076349 Jun 30 16:42:56.085677 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 510/1045] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:56 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:56.091957 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-786f6993-d820-456f-86c5-786b94fd351c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:56.092683 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-786f6993-d820-456f-86c5-786b94fd351c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:56.100767 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-786f6993-d820-456f-86c5-786b94fd351c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:56.101471 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-786f6993-d820-456f-86c5-786b94fd351c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:56.102443 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-786f6993-d820-456f-86c5-786b94fd351c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:56.103220 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-786f6993-d820-456f-86c5-786b94fd351c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:56.124197 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=77 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:42:56.180928 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-786f6993-d820-456f-86c5-786b94fd351c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:56.189131 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-786f6993-d820-456f-86c5-786b94fd351c tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1273 microversion: 2.1 time: 0.100526 Jun 30 16:42:56.189620 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 536/1046] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:56 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:42:57.102295 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-923f71ab-5a9a-483a-98f0-3b723fdef57a tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:57.102875 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-923f71ab-5a9a-483a-98f0-3b723fdef57a tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:57.160604 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-923f71ab-5a9a-483a-98f0-3b723fdef57a tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:57.167429 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-923f71ab-5a9a-483a-98f0-3b723fdef57a tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1258 microversion: 2.1 time: 0.069565 Jun 30 16:42:57.169867 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 511/1047] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:57 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:57.207440 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b9b10dd7-46ec-40dd-871f-a3d8792e164a tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:57.208385 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b9b10dd7-46ec-40dd-871f-a3d8792e164a tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:57.215581 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b9b10dd7-46ec-40dd-871f-a3d8792e164a tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:57.216042 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b9b10dd7-46ec-40dd-871f-a3d8792e164a tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:57.216821 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b9b10dd7-46ec-40dd-871f-a3d8792e164a tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:57.217363 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b9b10dd7-46ec-40dd-871f-a3d8792e164a tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:57.355059 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b9b10dd7-46ec-40dd-871f-a3d8792e164a tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:57.363876 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b9b10dd7-46ec-40dd-871f-a3d8792e164a tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1313 microversion: 2.1 time: 0.161355 Jun 30 16:42:57.373648 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 537/1048] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:57 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:57.897423 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-10d05694-c214-41d2-aa1e-7aa4aab56da1 req-c8dbc0f3-d4a2-4250-ad18-2c5ec7e85a33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e569eaa9-ea03-4708-ab10-f433322b39bc", "tag": "02c049bd-a0cf-41f3-aa6a-0aaa2ac71999"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:42:57.907113 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-10d05694-c214-41d2-aa1e-7aa4aab56da1 req-c8dbc0f3-d4a2-4250-ad18-2c5ec7e85a33 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:57.907976 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-10d05694-c214-41d2-aa1e-7aa4aab56da1 req-c8dbc0f3-d4a2-4250-ad18-2c5ec7e85a33 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:57.933228 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-10d05694-c214-41d2-aa1e-7aa4aab56da1 req-c8dbc0f3-d4a2-4250-ad18-2c5ec7e85a33 service nova] Creating event network-changed:02c049bd-a0cf-41f3-aa6a-0aaa2ac71999 for instance e569eaa9-ea03-4708-ab10-f433322b39bc on hv-cinder-83602 Jun 30 16:42:57.934830 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-10d05694-c214-41d2-aa1e-7aa4aab56da1 req-c8dbc0f3-d4a2-4250-ad18-2c5ec7e85a33 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042690 Jun 30 16:42:57.935422 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 512/1049] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:42:58.186988 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9925762e-61c9-4f51-97cf-dd4a40c7c7f7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:58.187690 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9925762e-61c9-4f51-97cf-dd4a40c7c7f7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:58.195846 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9925762e-61c9-4f51-97cf-dd4a40c7c7f7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:58.196310 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9925762e-61c9-4f51-97cf-dd4a40c7c7f7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:58.197119 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9925762e-61c9-4f51-97cf-dd4a40c7c7f7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:58.198894 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9925762e-61c9-4f51-97cf-dd4a40c7c7f7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:58.276703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9925762e-61c9-4f51-97cf-dd4a40c7c7f7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:58.286355 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9925762e-61c9-4f51-97cf-dd4a40c7c7f7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1310 microversion: 2.1 time: 0.103507 Jun 30 16:42:58.287319 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 538/1050] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:58 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1310 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:58.383259 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-dbca4935-1153-46f3-968b-b0b30e07c85d tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:58.384347 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-dbca4935-1153-46f3-968b-b0b30e07c85d tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:58.402944 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dbca4935-1153-46f3-968b-b0b30e07c85d tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:58.404632 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dbca4935-1153-46f3-968b-b0b30e07c85d tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:58.406101 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dbca4935-1153-46f3-968b-b0b30e07c85d tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:58.408435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dbca4935-1153-46f3-968b-b0b30e07c85d tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:58.583255 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-dbca4935-1153-46f3-968b-b0b30e07c85d tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:58.591081 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-dbca4935-1153-46f3-968b-b0b30e07c85d tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1313 microversion: 2.1 time: 0.212900 Jun 30 16:42:58.591719 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 513/1051] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:58 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:42:59.308842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6c22d0a4-b4bb-4b24-bfcc-9b7fab479bd3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:59.308842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6c22d0a4-b4bb-4b24-bfcc-9b7fab479bd3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:59.311006 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:42:59.315923 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6c22d0a4-b4bb-4b24-bfcc-9b7fab479bd3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:59.316382 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6c22d0a4-b4bb-4b24-bfcc-9b7fab479bd3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:59.317174 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6c22d0a4-b4bb-4b24-bfcc-9b7fab479bd3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:59.317614 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6c22d0a4-b4bb-4b24-bfcc-9b7fab479bd3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:59.386472 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6c22d0a4-b4bb-4b24-bfcc-9b7fab479bd3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:59.395723 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6c22d0a4-b4bb-4b24-bfcc-9b7fab479bd3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1316 microversion: 2.1 time: 0.091622 Jun 30 16:42:59.396329 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 539/1052] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:59 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1316 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:42:59.607526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-7b051c61-6214-45e4-9064-aa0f7026a6de tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:42:59.608146 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-7b051c61-6214-45e4-9064-aa0f7026a6de tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:42:59.616685 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b051c61-6214-45e4-9064-aa0f7026a6de tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:59.617332 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b051c61-6214-45e4-9064-aa0f7026a6de tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:59.618292 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b051c61-6214-45e4-9064-aa0f7026a6de tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:42:59.618743 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-7b051c61-6214-45e4-9064-aa0f7026a6de tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:42:59.785849 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-7b051c61-6214-45e4-9064-aa0f7026a6de tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:42:59.793732 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-7b051c61-6214-45e4-9064-aa0f7026a6de tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1313 microversion: 2.1 time: 0.190057 Jun 30 16:42:59.794308 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 514/1053] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:42:59 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:00.414086 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-475dac7a-e808-447a-bb50-9fe7d9af6ae3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:00.415634 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-475dac7a-e808-447a-bb50-9fe7d9af6ae3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:00.424024 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-475dac7a-e808-447a-bb50-9fe7d9af6ae3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:00.425007 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-475dac7a-e808-447a-bb50-9fe7d9af6ae3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:00.425551 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-475dac7a-e808-447a-bb50-9fe7d9af6ae3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:00.426079 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-475dac7a-e808-447a-bb50-9fe7d9af6ae3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:00.616386 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-475dac7a-e808-447a-bb50-9fe7d9af6ae3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:00.624999 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-475dac7a-e808-447a-bb50-9fe7d9af6ae3 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.215275 Jun 30 16:43:00.646931 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 540/1054] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:00 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:00.811048 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-28f7f42a-e73a-41da-882a-38504a5e9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:00.813194 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-28f7f42a-e73a-41da-882a-38504a5e9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:00.827158 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-28f7f42a-e73a-41da-882a-38504a5e9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:00.827847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-28f7f42a-e73a-41da-882a-38504a5e9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:00.829155 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-28f7f42a-e73a-41da-882a-38504a5e9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:00.835626 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-28f7f42a-e73a-41da-882a-38504a5e9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:01.039265 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-db1d5cda-9524-48ec-bf43-9d1a5d6e6b7b req-8d9518df-4a3d-43fd-99cc-cd3ea36735cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eebf23b5-45ea-41d1-a9f5-c8cb4fa09225", "tag": "8a69fd47-714b-49b4-a300-c1c75c143774"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:43:01.061210 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-db1d5cda-9524-48ec-bf43-9d1a5d6e6b7b req-8d9518df-4a3d-43fd-99cc-cd3ea36735cf service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:01.061533 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-db1d5cda-9524-48ec-bf43-9d1a5d6e6b7b req-8d9518df-4a3d-43fd-99cc-cd3ea36735cf service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:01.087863 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-db1d5cda-9524-48ec-bf43-9d1a5d6e6b7b req-8d9518df-4a3d-43fd-99cc-cd3ea36735cf service nova] Creating event network-changed:8a69fd47-714b-49b4-a300-c1c75c143774 for instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 on hv-cinder-83602 Jun 30 16:43:01.102662 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-db1d5cda-9524-48ec-bf43-9d1a5d6e6b7b req-8d9518df-4a3d-43fd-99cc-cd3ea36735cf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068118 Jun 30 16:43:01.109542 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 541/1055] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:43:01.133415 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-28f7f42a-e73a-41da-882a-38504a5e9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:01.152444 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-28f7f42a-e73a-41da-882a-38504a5e9789 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1313 microversion: 2.1 time: 0.345039 Jun 30 16:43:01.153630 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 515/1056] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:00 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:01.645026 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-eb1cf2d6-6877-4e42-9fbe-5ae8a695291a tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:01.645836 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-eb1cf2d6-6877-4e42-9fbe-5ae8a695291a tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:01.652573 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-eb1cf2d6-6877-4e42-9fbe-5ae8a695291a tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:01.653288 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-eb1cf2d6-6877-4e42-9fbe-5ae8a695291a tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:01.654396 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-eb1cf2d6-6877-4e42-9fbe-5ae8a695291a tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:01.654396 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-eb1cf2d6-6877-4e42-9fbe-5ae8a695291a tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:01.796222 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-eb1cf2d6-6877-4e42-9fbe-5ae8a695291a tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:01.807428 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-eb1cf2d6-6877-4e42-9fbe-5ae8a695291a tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.167723 Jun 30 16:43:01.808699 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 542/1057] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:01 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:02.173393 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-394e87b2-65b7-4eb4-9f50-8955874c019f tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:02.176271 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-394e87b2-65b7-4eb4-9f50-8955874c019f tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:02.180815 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-394e87b2-65b7-4eb4-9f50-8955874c019f tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:02.181261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-394e87b2-65b7-4eb4-9f50-8955874c019f tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:02.182028 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-394e87b2-65b7-4eb4-9f50-8955874c019f tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:02.182458 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-394e87b2-65b7-4eb4-9f50-8955874c019f tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:02.338121 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-394e87b2-65b7-4eb4-9f50-8955874c019f tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:02.358066 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-394e87b2-65b7-4eb4-9f50-8955874c019f tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1313 microversion: 2.1 time: 0.190917 Jun 30 16:43:02.359196 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 516/1058] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:02 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:02.826397 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c0d3520b-90d7-46ad-8e5c-52f3800392ed tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:02.827028 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c0d3520b-90d7-46ad-8e5c-52f3800392ed tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:02.833936 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c0d3520b-90d7-46ad-8e5c-52f3800392ed tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:02.834395 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c0d3520b-90d7-46ad-8e5c-52f3800392ed tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:02.835184 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c0d3520b-90d7-46ad-8e5c-52f3800392ed tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:02.835663 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c0d3520b-90d7-46ad-8e5c-52f3800392ed tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:03.007333 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c0d3520b-90d7-46ad-8e5c-52f3800392ed tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:03.018256 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c0d3520b-90d7-46ad-8e5c-52f3800392ed tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.196600 Jun 30 16:43:03.029248 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 543/1059] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:02 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:43:03.376353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c01ccea9-81dc-4736-9eb6-47dc55aac3ec tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:03.377157 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c01ccea9-81dc-4736-9eb6-47dc55aac3ec tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:03.387064 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c01ccea9-81dc-4736-9eb6-47dc55aac3ec tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:03.390936 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c01ccea9-81dc-4736-9eb6-47dc55aac3ec tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:03.392451 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c01ccea9-81dc-4736-9eb6-47dc55aac3ec tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:03.392963 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c01ccea9-81dc-4736-9eb6-47dc55aac3ec tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:03.543165 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c01ccea9-81dc-4736-9eb6-47dc55aac3ec tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:03.550868 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c01ccea9-81dc-4736-9eb6-47dc55aac3ec tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1313 microversion: 2.1 time: 0.178952 Jun 30 16:43:03.551441 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 517/1060] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:03 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:43:04.037170 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b2b3e9a1-1588-4e29-ae8c-ef64504e6018 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:04.038443 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b2b3e9a1-1588-4e29-ae8c-ef64504e6018 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:04.044790 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b2b3e9a1-1588-4e29-ae8c-ef64504e6018 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:04.045236 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b2b3e9a1-1588-4e29-ae8c-ef64504e6018 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:04.046273 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b2b3e9a1-1588-4e29-ae8c-ef64504e6018 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:04.046915 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b2b3e9a1-1588-4e29-ae8c-ef64504e6018 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:04.212473 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b2b3e9a1-1588-4e29-ae8c-ef64504e6018 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:04.220523 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b2b3e9a1-1588-4e29-ae8c-ef64504e6018 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.187769 Jun 30 16:43:04.221388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 544/1061] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:04 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:04.568931 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-abf02616-c309-4e8e-817c-949d93ad5964 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:04.569647 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-abf02616-c309-4e8e-817c-949d93ad5964 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:04.571648 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=2 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:43:04.577267 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-abf02616-c309-4e8e-817c-949d93ad5964 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:04.585037 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-abf02616-c309-4e8e-817c-949d93ad5964 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:04.586222 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-abf02616-c309-4e8e-817c-949d93ad5964 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:04.589738 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-abf02616-c309-4e8e-817c-949d93ad5964 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:04.702940 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-8c19b467-a09d-4cb8-b1f3-ddac6319f011 req-4ebb031b-af9b-43e4-983f-01bb5dbdf42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e569eaa9-ea03-4708-ab10-f433322b39bc", "name": "network-vif-plugged", "status": "completed", "tag": "02c049bd-a0cf-41f3-aa6a-0aaa2ac71999"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:43:04.713897 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-8c19b467-a09d-4cb8-b1f3-ddac6319f011 req-4ebb031b-af9b-43e4-983f-01bb5dbdf42f service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:04.714833 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-8c19b467-a09d-4cb8-b1f3-ddac6319f011 req-4ebb031b-af9b-43e4-983f-01bb5dbdf42f service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:04.731519 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-8c19b467-a09d-4cb8-b1f3-ddac6319f011 req-4ebb031b-af9b-43e4-983f-01bb5dbdf42f service nova] Creating event network-vif-plugged:02c049bd-a0cf-41f3-aa6a-0aaa2ac71999 for instance e569eaa9-ea03-4708-ab10-f433322b39bc on hv-cinder-83602 Jun 30 16:43:04.738572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-8c19b467-a09d-4cb8-b1f3-ddac6319f011 req-4ebb031b-af9b-43e4-983f-01bb5dbdf42f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039751 Jun 30 16:43:04.750091 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 545/1062] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:43:04.752794 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-abf02616-c309-4e8e-817c-949d93ad5964 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:04.759638 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-abf02616-c309-4e8e-817c-949d93ad5964 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1313 microversion: 2.1 time: 0.194932 Jun 30 16:43:04.760551 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 518/1063] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:04 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:05.240060 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-85029798-41fc-4c7d-85bf-1abdc13b3605 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:05.241124 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-85029798-41fc-4c7d-85bf-1abdc13b3605 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:05.244203 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=2 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:43:05.248688 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=8 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:43:05.252498 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-85029798-41fc-4c7d-85bf-1abdc13b3605 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:05.252977 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-85029798-41fc-4c7d-85bf-1abdc13b3605 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:05.253894 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-85029798-41fc-4c7d-85bf-1abdc13b3605 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:05.254446 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-85029798-41fc-4c7d-85bf-1abdc13b3605 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:05.406916 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-85029798-41fc-4c7d-85bf-1abdc13b3605 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:05.415388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-85029798-41fc-4c7d-85bf-1abdc13b3605 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.181354 Jun 30 16:43:05.416268 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 546/1064] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:05 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:05.788660 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-2c4053f1-e75f-4c77-8da3-4dab5b065f45 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:05.788660 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-2c4053f1-e75f-4c77-8da3-4dab5b065f45 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:05.788660 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2c4053f1-e75f-4c77-8da3-4dab5b065f45 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:05.789705 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2c4053f1-e75f-4c77-8da3-4dab5b065f45 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:05.789808 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2c4053f1-e75f-4c77-8da3-4dab5b065f45 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:05.790244 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-2c4053f1-e75f-4c77-8da3-4dab5b065f45 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:06.017701 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-2c4053f1-e75f-4c77-8da3-4dab5b065f45 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:06.027906 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-2c4053f1-e75f-4c77-8da3-4dab5b065f45 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1313 microversion: 2.1 time: 0.254866 Jun 30 16:43:06.029362 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 519/1065] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:05 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:06.433524 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7645acb3-5832-477b-ac35-6cc75a1782ee tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:06.434505 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-7645acb3-5832-477b-ac35-6cc75a1782ee tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:06.442238 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7645acb3-5832-477b-ac35-6cc75a1782ee tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:06.442689 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7645acb3-5832-477b-ac35-6cc75a1782ee tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:06.443796 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7645acb3-5832-477b-ac35-6cc75a1782ee tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:06.444244 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7645acb3-5832-477b-ac35-6cc75a1782ee tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:06.586384 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-7645acb3-5832-477b-ac35-6cc75a1782ee tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:06.594074 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7645acb3-5832-477b-ac35-6cc75a1782ee tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.164410 Jun 30 16:43:06.594748 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 547/1066] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:06 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:07.046022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-89a2ccf6-d814-4f49-b982-8d66b2ac91f5 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:07.047065 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-89a2ccf6-d814-4f49-b982-8d66b2ac91f5 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:07.054378 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-89a2ccf6-d814-4f49-b982-8d66b2ac91f5 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:07.055102 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-89a2ccf6-d814-4f49-b982-8d66b2ac91f5 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:07.056115 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-89a2ccf6-d814-4f49-b982-8d66b2ac91f5 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:07.056724 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-89a2ccf6-d814-4f49-b982-8d66b2ac91f5 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:07.164870 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell0:SELECT=14 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:43:07.256791 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-89a2ccf6-d814-4f49-b982-8d66b2ac91f5 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:07.265274 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-89a2ccf6-d814-4f49-b982-8d66b2ac91f5 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1313 microversion: 2.1 time: 0.223224 Jun 30 16:43:07.267128 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 520/1067] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:07 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1313 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:07.613714 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9f620235-bd14-413b-b060-f61214350a10 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:07.613714 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9f620235-bd14-413b-b060-f61214350a10 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:07.619549 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9f620235-bd14-413b-b060-f61214350a10 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:07.632794 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9f620235-bd14-413b-b060-f61214350a10 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:07.632794 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9f620235-bd14-413b-b060-f61214350a10 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:07.632794 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9f620235-bd14-413b-b060-f61214350a10 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:07.784362 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9f620235-bd14-413b-b060-f61214350a10 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:07.792128 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9f620235-bd14-413b-b060-f61214350a10 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.184976 Jun 30 16:43:07.795995 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 548/1068] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:07 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:08.284583 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-737d33d8-19ed-46d3-8128-0ab65e9b1583 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:08.285369 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-737d33d8-19ed-46d3-8128-0ab65e9b1583 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:08.292742 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-737d33d8-19ed-46d3-8128-0ab65e9b1583 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:08.293286 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-737d33d8-19ed-46d3-8128-0ab65e9b1583 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:08.294062 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-737d33d8-19ed-46d3-8128-0ab65e9b1583 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:08.294492 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-737d33d8-19ed-46d3-8128-0ab65e9b1583 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:08.444348 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-737d33d8-19ed-46d3-8128-0ab65e9b1583 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:08.452371 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-737d33d8-19ed-46d3-8128-0ab65e9b1583 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1313 microversion: 2.1 time: 0.172872 Jun 30 16:43:08.455285 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 521/1069] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:08 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:08.809827 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1da7c3bb-5d33-410c-9c6f-e07b9281edb1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:08.810442 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1da7c3bb-5d33-410c-9c6f-e07b9281edb1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:08.817401 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1da7c3bb-5d33-410c-9c6f-e07b9281edb1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:08.817844 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1da7c3bb-5d33-410c-9c6f-e07b9281edb1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:08.821983 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1da7c3bb-5d33-410c-9c6f-e07b9281edb1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:08.821983 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1da7c3bb-5d33-410c-9c6f-e07b9281edb1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:08.960266 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1da7c3bb-5d33-410c-9c6f-e07b9281edb1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:08.968046 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1da7c3bb-5d33-410c-9c6f-e07b9281edb1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.162072 Jun 30 16:43:08.968811 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 549/1070] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:08 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:09.470410 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f46c3866-8de9-4a3d-8603-4f15aee7ce85 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:09.471020 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f46c3866-8de9-4a3d-8603-4f15aee7ce85 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:09.477606 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f46c3866-8de9-4a3d-8603-4f15aee7ce85 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:09.478054 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f46c3866-8de9-4a3d-8603-4f15aee7ce85 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:09.478820 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f46c3866-8de9-4a3d-8603-4f15aee7ce85 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:09.479256 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f46c3866-8de9-4a3d-8603-4f15aee7ce85 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:09.613373 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f46c3866-8de9-4a3d-8603-4f15aee7ce85 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:09.621128 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f46c3866-8de9-4a3d-8603-4f15aee7ce85 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1313 microversion: 2.1 time: 0.154913 Jun 30 16:43:09.629993 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 522/1071] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:09 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:09.986075 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-4498a022-987f-4b57-aab7-a988f1c217ef tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:09.986709 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-4498a022-987f-4b57-aab7-a988f1c217ef tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:09.993770 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4498a022-987f-4b57-aab7-a988f1c217ef tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:09.994228 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4498a022-987f-4b57-aab7-a988f1c217ef tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:09.995010 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4498a022-987f-4b57-aab7-a988f1c217ef tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:09.995654 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-4498a022-987f-4b57-aab7-a988f1c217ef tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:10.130810 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-4498a022-987f-4b57-aab7-a988f1c217ef tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:10.138626 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-4498a022-987f-4b57-aab7-a988f1c217ef tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.157146 Jun 30 16:43:10.139206 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 550/1072] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:09 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:10.639988 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-ad17947a-71e1-46aa-9ca9-7aefe16c7408 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:10.640740 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-ad17947a-71e1-46aa-9ca9-7aefe16c7408 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:10.648596 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad17947a-71e1-46aa-9ca9-7aefe16c7408 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:10.649051 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad17947a-71e1-46aa-9ca9-7aefe16c7408 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:10.649861 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad17947a-71e1-46aa-9ca9-7aefe16c7408 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:10.650316 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-ad17947a-71e1-46aa-9ca9-7aefe16c7408 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:10.790022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-ad17947a-71e1-46aa-9ca9-7aefe16c7408 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:10.794441 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-ad17947a-71e1-46aa-9ca9-7aefe16c7408 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1313 microversion: 2.1 time: 0.158194 Jun 30 16:43:10.795026 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 523/1073] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:10 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:43:11.162233 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b78d5852-1ecf-4c30-a55d-1dd672947a5e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:11.162233 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b78d5852-1ecf-4c30-a55d-1dd672947a5e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:11.163734 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b78d5852-1ecf-4c30-a55d-1dd672947a5e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:11.164169 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b78d5852-1ecf-4c30-a55d-1dd672947a5e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:11.164931 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b78d5852-1ecf-4c30-a55d-1dd672947a5e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:11.165368 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b78d5852-1ecf-4c30-a55d-1dd672947a5e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:11.305393 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b78d5852-1ecf-4c30-a55d-1dd672947a5e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:11.314451 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b78d5852-1ecf-4c30-a55d-1dd672947a5e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.161542 Jun 30 16:43:11.314709 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 551/1074] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:11 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:11.811760 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-e1ea3067-a824-4ad7-bdb3-01cd71d63278 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:11.812370 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-e1ea3067-a824-4ad7-bdb3-01cd71d63278 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:11.819219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1ea3067-a824-4ad7-bdb3-01cd71d63278 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:11.819705 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1ea3067-a824-4ad7-bdb3-01cd71d63278 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:11.820533 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1ea3067-a824-4ad7-bdb3-01cd71d63278 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:11.821115 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-e1ea3067-a824-4ad7-bdb3-01cd71d63278 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:11.960578 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-e1ea3067-a824-4ad7-bdb3-01cd71d63278 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:11.968396 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-e1ea3067-a824-4ad7-bdb3-01cd71d63278 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1497 microversion: 2.1 time: 0.161043 Jun 30 16:43:11.969003 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 524/1075] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:11 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:12.332919 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-31f70abd-2dd7-4750-bdf7-46057132ec14 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:12.333530 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-31f70abd-2dd7-4750-bdf7-46057132ec14 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:12.340064 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-31f70abd-2dd7-4750-bdf7-46057132ec14 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:12.340514 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-31f70abd-2dd7-4750-bdf7-46057132ec14 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:12.341303 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-31f70abd-2dd7-4750-bdf7-46057132ec14 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:12.341698 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-31f70abd-2dd7-4750-bdf7-46057132ec14 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:12.471399 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-31f70abd-2dd7-4750-bdf7-46057132ec14 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:12.478835 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-31f70abd-2dd7-4750-bdf7-46057132ec14 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.150953 Jun 30 16:43:12.479403 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 552/1076] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:12 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:43:13.496418 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-812497a1-0a5e-403f-825b-26ec2f8d5600 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:13.497024 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-812497a1-0a5e-403f-825b-26ec2f8d5600 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:13.503559 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-812497a1-0a5e-403f-825b-26ec2f8d5600 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:13.504012 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-812497a1-0a5e-403f-825b-26ec2f8d5600 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:13.504777 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-812497a1-0a5e-403f-825b-26ec2f8d5600 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:13.505216 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-812497a1-0a5e-403f-825b-26ec2f8d5600 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:13.793385 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-812497a1-0a5e-403f-825b-26ec2f8d5600 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:13.800804 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-812497a1-0a5e-403f-825b-26ec2f8d5600 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.308218 Jun 30 16:43:13.801359 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 525/1077] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:13 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:14.817815 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c23ba68c-8e4c-49d3-9c44-b7845f5a580c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:14.818544 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c23ba68c-8e4c-49d3-9c44-b7845f5a580c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:14.824966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c23ba68c-8e4c-49d3-9c44-b7845f5a580c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:14.825417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c23ba68c-8e4c-49d3-9c44-b7845f5a580c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:14.826186 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c23ba68c-8e4c-49d3-9c44-b7845f5a580c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:14.826624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c23ba68c-8e4c-49d3-9c44-b7845f5a580c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:14.964686 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c23ba68c-8e4c-49d3-9c44-b7845f5a580c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:14.973350 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c23ba68c-8e4c-49d3-9c44-b7845f5a580c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.159654 Jun 30 16:43:14.973966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 553/1078] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:14 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:15.991986 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-734894db-a755-42fd-b6e9-0ab45cb6f145 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:15.992648 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-734894db-a755-42fd-b6e9-0ab45cb6f145 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:15.999762 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-734894db-a755-42fd-b6e9-0ab45cb6f145 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:16.000219 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-734894db-a755-42fd-b6e9-0ab45cb6f145 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:16.001855 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-734894db-a755-42fd-b6e9-0ab45cb6f145 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:16.001855 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-734894db-a755-42fd-b6e9-0ab45cb6f145 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:16.136596 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-734894db-a755-42fd-b6e9-0ab45cb6f145 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:16.144055 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-734894db-a755-42fd-b6e9-0ab45cb6f145 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.156618 Jun 30 16:43:16.144612 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 526/1079] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:15 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:17.161954 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d45cb3e1-bf8e-4fb9-9fbd-3e0b279373d7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:17.166638 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d45cb3e1-bf8e-4fb9-9fbd-3e0b279373d7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:17.169987 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d45cb3e1-bf8e-4fb9-9fbd-3e0b279373d7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:17.170443 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d45cb3e1-bf8e-4fb9-9fbd-3e0b279373d7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:17.171211 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d45cb3e1-bf8e-4fb9-9fbd-3e0b279373d7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:17.171679 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d45cb3e1-bf8e-4fb9-9fbd-3e0b279373d7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:17.186758 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=100 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:43:17.307679 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d45cb3e1-bf8e-4fb9-9fbd-3e0b279373d7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:17.315088 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d45cb3e1-bf8e-4fb9-9fbd-3e0b279373d7 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.157980 Jun 30 16:43:17.315837 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 554/1080] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:17 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:18.333599 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-795ed15e-a884-4c8d-9377-a97dd3315b3e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:18.334223 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-795ed15e-a884-4c8d-9377-a97dd3315b3e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:18.342052 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-795ed15e-a884-4c8d-9377-a97dd3315b3e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:18.342052 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-795ed15e-a884-4c8d-9377-a97dd3315b3e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:18.342745 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-795ed15e-a884-4c8d-9377-a97dd3315b3e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:18.342930 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-795ed15e-a884-4c8d-9377-a97dd3315b3e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:18.481934 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-795ed15e-a884-4c8d-9377-a97dd3315b3e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:18.489931 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-795ed15e-a884-4c8d-9377-a97dd3315b3e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.161115 Jun 30 16:43:18.490495 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 527/1081] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:18 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:19.112637 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-de4e5d2b-00fe-4b82-8529-6a718b17e597 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:19.113321 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-de4e5d2b-00fe-4b82-8529-6a718b17e597 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:19.119994 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-de4e5d2b-00fe-4b82-8529-6a718b17e597 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:19.120451 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-de4e5d2b-00fe-4b82-8529-6a718b17e597 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:19.121235 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-de4e5d2b-00fe-4b82-8529-6a718b17e597 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:19.121677 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-de4e5d2b-00fe-4b82-8529-6a718b17e597 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:19.148812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-de4e5d2b-00fe-4b82-8529-6a718b17e597 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Going to try to terminate instance {{(pid=124815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:43:19.506984 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d9a57402-9b30-4158-9ead-de1235a532d6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:19.507367 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d9a57402-9b30-4158-9ead-de1235a532d6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:19.511677 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-de4e5d2b-00fe-4b82-8529-6a718b17e597 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 204 len: 0 microversion: 2.1 time: 0.403253 Jun 30 16:43:19.512515 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 555/1082] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:43:19 2022] DELETE /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:43:19.514502 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d9a57402-9b30-4158-9ead-de1235a532d6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:19.515005 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d9a57402-9b30-4158-9ead-de1235a532d6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:19.515975 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d9a57402-9b30-4158-9ead-de1235a532d6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:19.516424 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d9a57402-9b30-4158-9ead-de1235a532d6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:19.522735 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-5d119531-59fc-4ad9-9956-3e55ba2351e4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:19.523577 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-5d119531-59fc-4ad9-9956-3e55ba2351e4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:19.530516 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5d119531-59fc-4ad9-9956-3e55ba2351e4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:19.531083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5d119531-59fc-4ad9-9956-3e55ba2351e4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:19.531976 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5d119531-59fc-4ad9-9956-3e55ba2351e4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:19.532493 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-5d119531-59fc-4ad9-9956-3e55ba2351e4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:19.536556 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=100 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:43:19.730732 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d9a57402-9b30-4158-9ead-de1235a532d6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:19.734609 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-5d119531-59fc-4ad9-9956-3e55ba2351e4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:19.738503 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d9a57402-9b30-4158-9ead-de1235a532d6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.235998 Jun 30 16:43:19.739073 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 528/1083] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:19 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:43:19.742483 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-5d119531-59fc-4ad9-9956-3e55ba2351e4 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1503 microversion: 2.1 time: 0.225678 Jun 30 16:43:19.743045 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 556/1084] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:19 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1503 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:20.477545 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-7552c15c-b2df-47c2-a92c-716a4ac3f9c7 req-f5309505-08f6-43f1-97f7-460a8eac534a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eebf23b5-45ea-41d1-a9f5-c8cb4fa09225", "name": "network-vif-plugged", "status": "completed", "tag": "8a69fd47-714b-49b4-a300-c1c75c143774"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:43:20.485537 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-7552c15c-b2df-47c2-a92c-716a4ac3f9c7 req-f5309505-08f6-43f1-97f7-460a8eac534a service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:20.485984 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-7552c15c-b2df-47c2-a92c-716a4ac3f9c7 req-f5309505-08f6-43f1-97f7-460a8eac534a service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:20.497767 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-7552c15c-b2df-47c2-a92c-716a4ac3f9c7 req-f5309505-08f6-43f1-97f7-460a8eac534a service nova] Creating event network-vif-plugged:8a69fd47-714b-49b4-a300-c1c75c143774 for instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 on hv-cinder-83602 Jun 30 16:43:20.502775 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-7552c15c-b2df-47c2-a92c-716a4ac3f9c7 req-f5309505-08f6-43f1-97f7-460a8eac534a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029021 Jun 30 16:43:20.503338 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 529/1085] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:43:20.755690 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-9ef32a1d-0085-4595-a0de-85185414163c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:20.756416 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-9ef32a1d-0085-4595-a0de-85185414163c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:20.763071 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9ef32a1d-0085-4595-a0de-85185414163c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:20.768373 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-6ce16438-43e3-4009-9513-de69024c7a5b tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:20.768839 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9ef32a1d-0085-4595-a0de-85185414163c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:20.768839 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9ef32a1d-0085-4595-a0de-85185414163c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:20.769037 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-6ce16438-43e3-4009-9513-de69024c7a5b tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:20.769133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-9ef32a1d-0085-4595-a0de-85185414163c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:20.771633 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6ce16438-43e3-4009-9513-de69024c7a5b tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:20.772167 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6ce16438-43e3-4009-9513-de69024c7a5b tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:20.773037 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6ce16438-43e3-4009-9513-de69024c7a5b tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:20.773400 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-6ce16438-43e3-4009-9513-de69024c7a5b tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:20.970178 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-9ef32a1d-0085-4595-a0de-85185414163c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:20.975552 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-6ce16438-43e3-4009-9513-de69024c7a5b tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:20.978623 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-9ef32a1d-0085-4595-a0de-85185414163c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.227253 Jun 30 16:43:20.979211 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 557/1086] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:20 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:43:20.983632 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-6ce16438-43e3-4009-9513-de69024c7a5b tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1503 microversion: 2.1 time: 0.227270 Jun 30 16:43:20.984194 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 530/1087] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:20 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:43:22.000159 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b0670100-3899-4f57-ae71-0292a60c8d0b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:22.002795 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b0670100-3899-4f57-ae71-0292a60c8d0b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:22.004557 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-059edfe5-a848-4482-8be5-b1382e07e0e1 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:22.006253 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-059edfe5-a848-4482-8be5-b1382e07e0e1 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:22.015088 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b0670100-3899-4f57-ae71-0292a60c8d0b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:22.015852 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b0670100-3899-4f57-ae71-0292a60c8d0b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:22.016683 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-059edfe5-a848-4482-8be5-b1382e07e0e1 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:22.017115 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b0670100-3899-4f57-ae71-0292a60c8d0b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:22.017462 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-059edfe5-a848-4482-8be5-b1382e07e0e1 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:22.018255 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b0670100-3899-4f57-ae71-0292a60c8d0b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:22.018996 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-059edfe5-a848-4482-8be5-b1382e07e0e1 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:22.019753 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-059edfe5-a848-4482-8be5-b1382e07e0e1 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:22.245149 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-b0670100-3899-4f57-ae71-0292a60c8d0b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:22.253070 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-059edfe5-a848-4482-8be5-b1382e07e0e1 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:22.256510 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b0670100-3899-4f57-ae71-0292a60c8d0b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.264045 Jun 30 16:43:22.257209 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 558/1088] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:21 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:22.260799 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-059edfe5-a848-4482-8be5-b1382e07e0e1 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1503 microversion: 2.1 time: 0.262661 Jun 30 16:43:22.261365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 531/1089] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:21 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1503 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:22.357999 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-f5f1c676-a482-4798-a9a1-adad8f13c71e req-93c0b9a8-1d2c-49e4-8ed8-29bcda174228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e569eaa9-ea03-4708-ab10-f433322b39bc", "name": "network-vif-deleted", "tag": "02c049bd-a0cf-41f3-aa6a-0aaa2ac71999"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:43:22.366141 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-f5f1c676-a482-4798-a9a1-adad8f13c71e req-93c0b9a8-1d2c-49e4-8ed8-29bcda174228 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:22.366593 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-f5f1c676-a482-4798-a9a1-adad8f13c71e req-93c0b9a8-1d2c-49e4-8ed8-29bcda174228 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:22.377677 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-f5f1c676-a482-4798-a9a1-adad8f13c71e req-93c0b9a8-1d2c-49e4-8ed8-29bcda174228 service nova] Creating event network-vif-deleted:02c049bd-a0cf-41f3-aa6a-0aaa2ac71999 for instance e569eaa9-ea03-4708-ab10-f433322b39bc on hv-cinder-83602 Jun 30 16:43:22.382510 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-f5f1c676-a482-4798-a9a1-adad8f13c71e req-93c0b9a8-1d2c-49e4-8ed8-29bcda174228 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028253 Jun 30 16:43:22.383083 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 559/1090] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:43:23.273833 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3ab3ff7d-17fb-453d-879e-67b0afaa5a18 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:23.274401 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3ab3ff7d-17fb-453d-879e-67b0afaa5a18 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:23.279112 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-723e5480-a28a-4945-bb30-403bdf5c2e75 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:23.279830 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-723e5480-a28a-4945-bb30-403bdf5c2e75 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:23.281209 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3ab3ff7d-17fb-453d-879e-67b0afaa5a18 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:23.281670 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3ab3ff7d-17fb-453d-879e-67b0afaa5a18 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:23.282450 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3ab3ff7d-17fb-453d-879e-67b0afaa5a18 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:23.282895 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3ab3ff7d-17fb-453d-879e-67b0afaa5a18 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:23.286352 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-723e5480-a28a-4945-bb30-403bdf5c2e75 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:23.286834 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-723e5480-a28a-4945-bb30-403bdf5c2e75 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:23.287645 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-723e5480-a28a-4945-bb30-403bdf5c2e75 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:23.288092 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-723e5480-a28a-4945-bb30-403bdf5c2e75 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:23.374935 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-723e5480-a28a-4945-bb30-403bdf5c2e75 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:23.383251 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-723e5480-a28a-4945-bb30-403bdf5c2e75 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1461 microversion: 2.1 time: 0.108692 Jun 30 16:43:23.383869 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 560/1091] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:23 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1461 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:43:23.443462 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3ab3ff7d-17fb-453d-879e-67b0afaa5a18 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:23.451150 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3ab3ff7d-17fb-453d-879e-67b0afaa5a18 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.181286 Jun 30 16:43:23.451730 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 532/1092] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:23 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:24.400302 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d19c43c9-6892-4c52-98ee-a8ed0d2d5045 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:24.400928 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d19c43c9-6892-4c52-98ee-a8ed0d2d5045 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:24.407425 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d19c43c9-6892-4c52-98ee-a8ed0d2d5045 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:24.407919 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d19c43c9-6892-4c52-98ee-a8ed0d2d5045 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:24.408998 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d19c43c9-6892-4c52-98ee-a8ed0d2d5045 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:24.409335 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d19c43c9-6892-4c52-98ee-a8ed0d2d5045 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:24.468579 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-450b2243-1de3-48e4-8ae6-41fd236b5b6c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:24.469994 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-450b2243-1de3-48e4-8ae6-41fd236b5b6c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:24.472049 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d19c43c9-6892-4c52-98ee-a8ed0d2d5045 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:24.477151 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-450b2243-1de3-48e4-8ae6-41fd236b5b6c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:24.477605 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-450b2243-1de3-48e4-8ae6-41fd236b5b6c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:24.478418 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-450b2243-1de3-48e4-8ae6-41fd236b5b6c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:24.478852 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-450b2243-1de3-48e4-8ae6-41fd236b5b6c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:24.479523 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d19c43c9-6892-4c52-98ee-a8ed0d2d5045 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1298 microversion: 2.1 time: 0.083069 Jun 30 16:43:24.480101 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 561/1093] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:24 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:24.613440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-450b2243-1de3-48e4-8ae6-41fd236b5b6c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:24.622144 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-450b2243-1de3-48e4-8ae6-41fd236b5b6c tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.157063 Jun 30 16:43:24.623166 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 533/1094] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:24 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:43:25.497554 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-fa4e7e31-66c5-4942-9236-cb2c2f9b4933 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:25.498292 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-fa4e7e31-66c5-4942-9236-cb2c2f9b4933 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:25.505389 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fa4e7e31-66c5-4942-9236-cb2c2f9b4933 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:25.505849 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fa4e7e31-66c5-4942-9236-cb2c2f9b4933 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:25.506623 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fa4e7e31-66c5-4942-9236-cb2c2f9b4933 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:25.507069 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fa4e7e31-66c5-4942-9236-cb2c2f9b4933 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:25.538076 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fa4e7e31-66c5-4942-9236-cb2c2f9b4933 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:25.538532 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fa4e7e31-66c5-4942-9236-cb2c2f9b4933 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:25.538986 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.objects.instance [None req-fa4e7e31-66c5-4942-9236-cb2c2f9b4933 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lazy-loading 'fault' on Instance uuid e569eaa9-ea03-4708-ab10-f433322b39bc {{(pid=124815) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:43:25.580869 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-fa4e7e31-66c5-4942-9236-cb2c2f9b4933 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f58941916ebe4a68a9a9a2b04b745ee2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc48c4912c8647d482593a28474d6b14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:25.588856 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-fa4e7e31-66c5-4942-9236-cb2c2f9b4933 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 200 len: 1303 microversion: 2.1 time: 0.095772 Jun 30 16:43:25.589390 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 562/1095] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:25 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:25.640719 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0519e877-19ee-4de2-82c5-27627a9f74d5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:25.641344 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0519e877-19ee-4de2-82c5-27627a9f74d5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:25.648786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0519e877-19ee-4de2-82c5-27627a9f74d5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:25.649167 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0519e877-19ee-4de2-82c5-27627a9f74d5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:25.649920 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0519e877-19ee-4de2-82c5-27627a9f74d5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:25.650349 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0519e877-19ee-4de2-82c5-27627a9f74d5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:25.789221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-0519e877-19ee-4de2-82c5-27627a9f74d5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:25.799869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0519e877-19ee-4de2-82c5-27627a9f74d5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1358 microversion: 2.1 time: 0.162289 Jun 30 16:43:25.800605 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 534/1096] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:25 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:25.961564 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1944168011", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1686313724", "security_groups": [{"name": "tempest-secgroup-smoke-1280353264"}], "block_device_mapping_v2": [{"uuid": "ed690a1f-1c38-429f-a844-cb7999809d32", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "65fa0cba-7cff-4856-97c9-e4f078bde7b0"}]}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:43:26.080932 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.network.neutron [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] validate_networks() for [('65fa0cba-7cff-4856-97c9-e4f078bde7b0', None, None, None, None, None)] {{(pid=124815) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 30 16:43:26.497155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Flavor limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 30 16:43:26.497587 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Image limits 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 30 16:43:26.498063 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Flavor pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 30 16:43:26.498624 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Image pref 0:0:0 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 30 16:43:26.498945 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.virt.hardware [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124815) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 30 16:43:26.509666 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:26.510115 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:26.510918 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:26.511353 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:26.528937 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Getting quotas for project 99847b649bfd4ca6a33cb2ea97ad0469. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 30 16:43:26.534443 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.quota [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Getting quotas for user bb8a8a4e8b634322a92992379c98b721 and project 99847b649bfd4ca6a33cb2ea97ad0469. Resources: {'instances', 'ram', 'cores'} {{(pid=124815) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 30 16:43:26.593153 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Going to run 1 instances... {{(pid=124815) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 30 16:43:26.595253 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed690a1f-1c38-429f-a844-cb7999809d32',volume_size=None,volume_type=None)] {{(pid=124815) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 30 16:43:26.606246 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-04333851-92e2-40e2-bf7f-e77f2c373f03 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:26.614441 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-04333851-92e2-40e2-bf7f-e77f2c373f03 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] [instance: e569eaa9-ea03-4708-ab10-f433322b39bc] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:26.616631 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:43:26.622238 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-04333851-92e2-40e2-bf7f-e77f2c373f03 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:26.622546 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-04333851-92e2-40e2-bf7f-e77f2c373f03 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:26.623325 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-04333851-92e2-40e2-bf7f-e77f2c373f03 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:26.623942 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-04333851-92e2-40e2-bf7f-e77f2c373f03 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:26.638170 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-04333851-92e2-40e2-bf7f-e77f2c373f03 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] HTTP exception thrown: Instance e569eaa9-ea03-4708-ab10-f433322b39bc could not be found. Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-04333851-92e2-40e2-bf7f-e77f2c373f03 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Request method failure captured: Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc HTTP/1.1 Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdJtyouNpEdaVnAdUlJ5I2iGmYe_oiybbUpKnYx2GhbgKF-0BWCVWv0XLVq6JsDw7-ic9Gk_4LWdwD7OjSTjAM1r1pzjl329psgFMer7AyRXSZjxwqEhVQY-go03rDMDp61PpBKQCeCp3OBjK8bN1zP8b52NnfqTjeJ5GRT06E7KDVs Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: fc48c4912c8647d482593a28474d6b14 Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-VolumesActionsTest-2040525805 Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:43:26.639898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:43:26.642040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fc48c4912c8647d482593a28474d6b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/fc48c4912c8647d482593a28474d6b14"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_fc48c4912c8647d482593a28474d6b14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/fc48c4912c8647d482593a28474d6b14"}]}] Jun 30 16:43:26.642040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-VolumesActionsTest-2040525805 Jun 30 16:43:26.642040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: fc48c4912c8647d482593a28474d6b14 Jun 30 16:43:26.642040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-VolumesActionsTest-2040525805 Jun 30 16:43:26.642040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-VolumesActionsTest-2040525805-project Jun 30 16:43:26.642040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:43:26.642040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:43:26.642040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: f58941916ebe4a68a9a9a2b04b745ee2 Jun 30 16:43:26.642040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-VolumesActionsTest-2040525805-project Jun 30 16:43:26.642040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:43:26.642040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance e569eaa9-ea03-4708-ab10-f433322b39bc could not be found. Jun 30 16:43:26.642040 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': 'e569eaa9-ea03-4708-ab10-f433322b39bc'} Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e569eaa9-ea03-4708-ab10-f433322b39bc could not be found. Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:43:26.643459 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e569eaa9-ea03-4708-ab10-f433322b39bc could not be found. Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e569eaa9-ea03-4708-ab10-f433322b39bc could not be found. Jun 30 16:43:26.645133 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:43:26.649305 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-04333851-92e2-40e2-bf7f-e77f2c373f03 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] Returning 404 to user: Instance e569eaa9-ea03-4708-ab10-f433322b39bc could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:43:26.649305 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-04333851-92e2-40e2-bf7f-e77f2c373f03 tempest-VolumesActionsTest-2040525805 tempest-VolumesActionsTest-2040525805-project] 10.222.0.67 "GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc" status: 404 len: 111 microversion: 2.1 time: 0.038849 Jun 30 16:43:26.649305 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 535/1097] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:26 2022] GET /compute/v2.1/servers/e569eaa9-ea03-4708-ab10-f433322b39bc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:43:26.817896 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-d0fa2691-8936-42f3-a4ba-947d7234dd96 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:26.818513 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-d0fa2691-8936-42f3-a4ba-947d7234dd96 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:26.826054 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d0fa2691-8936-42f3-a4ba-947d7234dd96 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:26.826505 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d0fa2691-8936-42f3-a4ba-947d7234dd96 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:26.827281 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d0fa2691-8936-42f3-a4ba-947d7234dd96 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:26.827758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-d0fa2691-8936-42f3-a4ba-947d7234dd96 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:26.973392 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-d0fa2691-8936-42f3-a4ba-947d7234dd96 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:26.981816 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-d0fa2691-8936-42f3-a4ba-947d7234dd96 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1549 microversion: 2.1 time: 0.168403 Jun 30 16:43:26.982161 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 536/1098] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:26 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:43:27.007934 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-12e8a8d7-1fbb-46a1-a9b3-7a69ed12331b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:27.007934 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-12e8a8d7-1fbb-46a1-a9b3-7a69ed12331b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:27.013062 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12e8a8d7-1fbb-46a1-a9b3-7a69ed12331b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:27.013520 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12e8a8d7-1fbb-46a1-a9b3-7a69ed12331b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:27.014301 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12e8a8d7-1fbb-46a1-a9b3-7a69ed12331b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:27.014962 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-12e8a8d7-1fbb-46a1-a9b3-7a69ed12331b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:27.062877 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-a56a1d0b-4416-4ced-9076-620f3de1db22 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.105209 Jun 30 16:43:27.063600 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 563/1099] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 30 16:43:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 30 16:43:27.086129 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7bdeeeed-6b45-473e-8177-65dd42e8e190 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:27.086129 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-7bdeeeed-6b45-473e-8177-65dd42e8e190 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:27.160679 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-7bdeeeed-6b45-473e-8177-65dd42e8e190 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:27.179128 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7bdeeeed-6b45-473e-8177-65dd42e8e190 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1095 microversion: 2.1 time: 0.101000 Jun 30 16:43:27.187533 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 564/1100] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:27 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1095 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:43:27.239847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-12e8a8d7-1fbb-46a1-a9b3-7a69ed12331b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:27.248843 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-12e8a8d7-1fbb-46a1-a9b3-7a69ed12331b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1549 microversion: 2.1 time: 0.250421 Jun 30 16:43:27.260222 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 537/1101] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:26 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1549 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:27.271727 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8a2016a4-58eb-4fa2-a05a-4f3c9cd9bbd6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:27.271727 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8a2016a4-58eb-4fa2-a05a-4f3c9cd9bbd6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:27.271727 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8a2016a4-58eb-4fa2-a05a-4f3c9cd9bbd6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Searching by: {'deleted': False, 'project_id': 'ce9b910eae974562929f660ba8c7af4c'} {{(pid=124815) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 30 16:43:27.277864 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8a2016a4-58eb-4fa2-a05a-4f3c9cd9bbd6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:27.278370 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8a2016a4-58eb-4fa2-a05a-4f3c9cd9bbd6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:27.279465 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8a2016a4-58eb-4fa2-a05a-4f3c9cd9bbd6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:27.279754 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8a2016a4-58eb-4fa2-a05a-4f3c9cd9bbd6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:27.378942 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.multi_cell_list [None req-8a2016a4-58eb-4fa2-a05a-4f3c9cd9bbd6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124815) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 30 16:43:27.472130 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8a2016a4-58eb-4fa2-a05a-4f3c9cd9bbd6 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209829 Jun 30 16:43:27.472739 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 565/1102] 10.222.0.67 () {58 vars in 1124 bytes} [Thu Jun 30 16:43:27 2022] GET /compute/v2.1/servers => generated 342 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:43:27.483165 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-403d730e-039d-4e13-a583-912c3d90ad4b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:27.483826 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-403d730e-039d-4e13-a583-912c3d90ad4b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:27.490351 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-403d730e-039d-4e13-a583-912c3d90ad4b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:27.490880 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-403d730e-039d-4e13-a583-912c3d90ad4b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:27.496405 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-403d730e-039d-4e13-a583-912c3d90ad4b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:27.496405 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-403d730e-039d-4e13-a583-912c3d90ad4b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:27.631524 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-403d730e-039d-4e13-a583-912c3d90ad4b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:27.641071 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-403d730e-039d-4e13-a583-912c3d90ad4b tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1549 microversion: 2.1 time: 0.161981 Jun 30 16:43:27.642357 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 538/1103] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:27 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:28.199245 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c3d9444c-b7e7-4901-994a-8812905e1a3f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:28.199959 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c3d9444c-b7e7-4901-994a-8812905e1a3f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:28.207950 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3d9444c-b7e7-4901-994a-8812905e1a3f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:28.211134 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3d9444c-b7e7-4901-994a-8812905e1a3f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:28.211134 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3d9444c-b7e7-4901-994a-8812905e1a3f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:28.211134 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c3d9444c-b7e7-4901-994a-8812905e1a3f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:28.276864 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-c3d9444c-b7e7-4901-994a-8812905e1a3f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:28.285414 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c3d9444c-b7e7-4901-994a-8812905e1a3f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1145 microversion: 2.1 time: 0.090032 Jun 30 16:43:28.286210 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 566/1104] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:28 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:29.303151 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5bd1214e-c7fe-4cf3-80e6-f28416bcc5ec tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:29.303693 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5bd1214e-c7fe-4cf3-80e6-f28416bcc5ec tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:29.310704 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5bd1214e-c7fe-4cf3-80e6-f28416bcc5ec tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:29.311156 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5bd1214e-c7fe-4cf3-80e6-f28416bcc5ec tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:29.311955 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5bd1214e-c7fe-4cf3-80e6-f28416bcc5ec tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:29.312397 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5bd1214e-c7fe-4cf3-80e6-f28416bcc5ec tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:29.376224 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5bd1214e-c7fe-4cf3-80e6-f28416bcc5ec tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:29.383853 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5bd1214e-c7fe-4cf3-80e6-f28416bcc5ec tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1137 microversion: 2.1 time: 0.085266 Jun 30 16:43:29.384706 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 539/1105] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:29 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:30.400764 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-d5484776-f423-46d3-a68d-ce826241548c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:30.401356 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-d5484776-f423-46d3-a68d-ce826241548c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:30.408058 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d5484776-f423-46d3-a68d-ce826241548c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:30.408689 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d5484776-f423-46d3-a68d-ce826241548c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:30.409380 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d5484776-f423-46d3-a68d-ce826241548c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:30.409818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-d5484776-f423-46d3-a68d-ce826241548c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:30.470987 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-d5484776-f423-46d3-a68d-ce826241548c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:30.478824 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-d5484776-f423-46d3-a68d-ce826241548c tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1137 microversion: 2.1 time: 0.081911 Jun 30 16:43:30.479388 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 567/1106] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:30 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:31.495994 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5edfab2c-7525-45fa-8935-1079fb8552cd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:31.496608 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5edfab2c-7525-45fa-8935-1079fb8552cd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:31.504102 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5edfab2c-7525-45fa-8935-1079fb8552cd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:31.504556 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5edfab2c-7525-45fa-8935-1079fb8552cd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:31.505472 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5edfab2c-7525-45fa-8935-1079fb8552cd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:31.505919 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5edfab2c-7525-45fa-8935-1079fb8552cd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:31.584364 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5edfab2c-7525-45fa-8935-1079fb8552cd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:31.593262 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5edfab2c-7525-45fa-8935-1079fb8552cd tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1193 microversion: 2.1 time: 0.100972 Jun 30 16:43:31.593970 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 540/1107] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:31 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1193 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:32.641972 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-669196a7-350a-47be-9ea4-47c21fdf1b52 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:32.641972 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-669196a7-350a-47be-9ea4-47c21fdf1b52 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:32.641972 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:43:32.641972 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-669196a7-350a-47be-9ea4-47c21fdf1b52 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:32.642749 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-669196a7-350a-47be-9ea4-47c21fdf1b52 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:32.642749 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-669196a7-350a-47be-9ea4-47c21fdf1b52 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:32.642749 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-669196a7-350a-47be-9ea4-47c21fdf1b52 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:32.735176 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-669196a7-350a-47be-9ea4-47c21fdf1b52 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:32.747722 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-669196a7-350a-47be-9ea4-47c21fdf1b52 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1211 microversion: 2.1 time: 0.139526 Jun 30 16:43:32.748753 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 568/1108] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:32 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1211 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:32.870018 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-56b82b0d-b463-4eb9-bc04-df70b5fd5991 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56aacffe-9f52-4586-b91a-fdb1aa76a885"}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:43:32.874841 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-56b82b0d-b463-4eb9-bc04-df70b5fd5991 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:32.883793 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-56b82b0d-b463-4eb9-bc04-df70b5fd5991 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:32.884298 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-56b82b0d-b463-4eb9-bc04-df70b5fd5991 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:32.888977 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-56b82b0d-b463-4eb9-bc04-df70b5fd5991 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:32.891357 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-56b82b0d-b463-4eb9-bc04-df70b5fd5991 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:33.798128 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6d0efc37-6c34-4c48-99a4-20361ecf520a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:33.802584 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6d0efc37-6c34-4c48-99a4-20361ecf520a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:33.829998 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d0efc37-6c34-4c48-99a4-20361ecf520a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:33.832016 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d0efc37-6c34-4c48-99a4-20361ecf520a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:33.834085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d0efc37-6c34-4c48-99a4-20361ecf520a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:33.835299 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6d0efc37-6c34-4c48-99a4-20361ecf520a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:34.082312 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6d0efc37-6c34-4c48-99a4-20361ecf520a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:34.098440 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6d0efc37-6c34-4c48-99a4-20361ecf520a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1279 microversion: 2.1 time: 0.335087 Jun 30 16:43:34.099820 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 569/1109] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:33 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1279 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:34.406445 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-826bc288-ca8d-4c9e-91bd-9f71fad79e3b req-9c66d5e2-e653-4bfb-b387-c6360f688502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cef79c1-fa15-4e49-8321-cc34f0fb26d4", "tag": "f851ca38-1a08-4d45-b314-d75329a56f1b"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:43:34.435847 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-826bc288-ca8d-4c9e-91bd-9f71fad79e3b req-9c66d5e2-e653-4bfb-b387-c6360f688502 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:34.443911 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-826bc288-ca8d-4c9e-91bd-9f71fad79e3b req-9c66d5e2-e653-4bfb-b387-c6360f688502 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:34.444091 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-56b82b0d-b463-4eb9-bc04-df70b5fd5991 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "POST /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.575609 Jun 30 16:43:34.444091 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 541/1110] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 30 16:43:32 2022] POST /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/os-volume_attachments => generated 194 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:43:34.481572 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-826bc288-ca8d-4c9e-91bd-9f71fad79e3b req-9c66d5e2-e653-4bfb-b387-c6360f688502 service nova] Creating event network-changed:f851ca38-1a08-4d45-b314-d75329a56f1b for instance 6cef79c1-fa15-4e49-8321-cc34f0fb26d4 on hv-cinder-83602 Jun 30 16:43:34.488773 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-826bc288-ca8d-4c9e-91bd-9f71fad79e3b req-9c66d5e2-e653-4bfb-b387-c6360f688502 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094281 Jun 30 16:43:34.489379 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 570/1111] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:43:35.117082 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-a4c98005-c86b-43b2-8844-6e2772f8391a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:35.118475 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-a4c98005-c86b-43b2-8844-6e2772f8391a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:35.126303 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a4c98005-c86b-43b2-8844-6e2772f8391a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:35.133224 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a4c98005-c86b-43b2-8844-6e2772f8391a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:35.133224 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a4c98005-c86b-43b2-8844-6e2772f8391a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:35.133224 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-a4c98005-c86b-43b2-8844-6e2772f8391a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:35.413781 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-a4c98005-c86b-43b2-8844-6e2772f8391a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:35.423651 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-a4c98005-c86b-43b2-8844-6e2772f8391a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1267 microversion: 2.1 time: 0.311840 Jun 30 16:43:35.429767 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 542/1112] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:35 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1267 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:36.447077 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-1ab31172-6106-4255-b18b-efc01fd3c47a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:36.449461 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-1ab31172-6106-4255-b18b-efc01fd3c47a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:36.456515 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1ab31172-6106-4255-b18b-efc01fd3c47a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:36.456970 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1ab31172-6106-4255-b18b-efc01fd3c47a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:36.457750 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1ab31172-6106-4255-b18b-efc01fd3c47a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:36.458192 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-1ab31172-6106-4255-b18b-efc01fd3c47a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:36.667174 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-1ab31172-6106-4255-b18b-efc01fd3c47a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:36.682020 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:43:36.687323 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-1ab31172-6106-4255-b18b-efc01fd3c47a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1267 microversion: 2.1 time: 0.245189 Jun 30 16:43:36.691333 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 571/1113] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:36 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1267 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:37.707780 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-5f656420-a6e8-47a9-905e-fb6171f2874b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:37.709147 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-5f656420-a6e8-47a9-905e-fb6171f2874b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:37.720739 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5f656420-a6e8-47a9-905e-fb6171f2874b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:37.721234 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5f656420-a6e8-47a9-905e-fb6171f2874b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:37.722062 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5f656420-a6e8-47a9-905e-fb6171f2874b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:37.722482 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-5f656420-a6e8-47a9-905e-fb6171f2874b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:37.924872 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-5f656420-a6e8-47a9-905e-fb6171f2874b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:37.932995 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-5f656420-a6e8-47a9-905e-fb6171f2874b tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1267 microversion: 2.1 time: 0.230615 Jun 30 16:43:37.934351 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 543/1114] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:37 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:38.951034 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-48b43384-546f-45a9-816a-88adfc2ef78f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:38.951827 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-48b43384-546f-45a9-816a-88adfc2ef78f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:38.954977 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=8 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:43:38.956741 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell0:SELECT=4 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:43:38.961394 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-48b43384-546f-45a9-816a-88adfc2ef78f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:38.961948 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-48b43384-546f-45a9-816a-88adfc2ef78f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:38.962815 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-48b43384-546f-45a9-816a-88adfc2ef78f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:38.963326 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-48b43384-546f-45a9-816a-88adfc2ef78f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:39.113779 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-48b43384-546f-45a9-816a-88adfc2ef78f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:39.122073 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-48b43384-546f-45a9-816a-88adfc2ef78f tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1267 microversion: 2.1 time: 0.175286 Jun 30 16:43:39.122671 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 572/1115] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:38 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:40.139523 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-dabec539-0130-4728-a7a1-b0f8efabcc1a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:40.140261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-dabec539-0130-4728-a7a1-b0f8efabcc1a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:40.147917 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dabec539-0130-4728-a7a1-b0f8efabcc1a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:40.148371 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dabec539-0130-4728-a7a1-b0f8efabcc1a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:40.149149 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dabec539-0130-4728-a7a1-b0f8efabcc1a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:40.149587 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-dabec539-0130-4728-a7a1-b0f8efabcc1a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:40.301426 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-dabec539-0130-4728-a7a1-b0f8efabcc1a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:40.309217 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-dabec539-0130-4728-a7a1-b0f8efabcc1a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1267 microversion: 2.1 time: 0.173548 Jun 30 16:43:40.310151 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 544/1116] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:40 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:41.327011 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-765092a9-9577-4f98-b660-8e875c119bb2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:41.327798 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-765092a9-9577-4f98-b660-8e875c119bb2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:41.336955 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-765092a9-9577-4f98-b660-8e875c119bb2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:41.337756 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-765092a9-9577-4f98-b660-8e875c119bb2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:41.338805 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-765092a9-9577-4f98-b660-8e875c119bb2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:41.339519 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-765092a9-9577-4f98-b660-8e875c119bb2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:41.491037 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-765092a9-9577-4f98-b660-8e875c119bb2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:41.498970 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-765092a9-9577-4f98-b660-8e875c119bb2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1267 microversion: 2.1 time: 0.175835 Jun 30 16:43:41.499556 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 573/1117] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:41 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:42.517055 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-daffd8d7-d636-4cfb-887d-386bd56439bc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:42.517711 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-daffd8d7-d636-4cfb-887d-386bd56439bc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:42.524699 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-daffd8d7-d636-4cfb-887d-386bd56439bc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:42.525159 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-daffd8d7-d636-4cfb-887d-386bd56439bc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:42.525991 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-daffd8d7-d636-4cfb-887d-386bd56439bc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:42.526463 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-daffd8d7-d636-4cfb-887d-386bd56439bc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:42.529283 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:43:42.672223 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-daffd8d7-d636-4cfb-887d-386bd56439bc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:42.680940 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-daffd8d7-d636-4cfb-887d-386bd56439bc tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1267 microversion: 2.1 time: 0.167578 Jun 30 16:43:42.681954 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 545/1118] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:42 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:43.708668 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-158e1cf6-490c-4fbe-b7f4-d1543051b101 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:43.709258 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-158e1cf6-490c-4fbe-b7f4-d1543051b101 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:43.715709 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-158e1cf6-490c-4fbe-b7f4-d1543051b101 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:43.716170 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-158e1cf6-490c-4fbe-b7f4-d1543051b101 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:43.717320 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-158e1cf6-490c-4fbe-b7f4-d1543051b101 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:43.717771 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-158e1cf6-490c-4fbe-b7f4-d1543051b101 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:43.867653 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-158e1cf6-490c-4fbe-b7f4-d1543051b101 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:43.876204 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-158e1cf6-490c-4fbe-b7f4-d1543051b101 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1267 microversion: 2.1 time: 0.175318 Jun 30 16:43:43.876770 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 574/1119] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:43 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:44.895445 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-74fb631f-f673-4d8f-b3e5-58888fc2e159 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:44.896504 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-74fb631f-f673-4d8f-b3e5-58888fc2e159 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:44.903060 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-74fb631f-f673-4d8f-b3e5-58888fc2e159 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:44.903936 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-74fb631f-f673-4d8f-b3e5-58888fc2e159 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:44.904807 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-74fb631f-f673-4d8f-b3e5-58888fc2e159 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:44.905344 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-74fb631f-f673-4d8f-b3e5-58888fc2e159 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:45.092526 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-74fb631f-f673-4d8f-b3e5-58888fc2e159 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:45.102628 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-74fb631f-f673-4d8f-b3e5-58888fc2e159 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1267 microversion: 2.1 time: 0.212339 Jun 30 16:43:45.104626 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 546/1120] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:44 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:45.389454 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e6732652-d36b-4347-96d3-6a9f8b15e2da tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:45.390061 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e6732652-d36b-4347-96d3-6a9f8b15e2da tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:45.398050 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e6732652-d36b-4347-96d3-6a9f8b15e2da tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:45.398505 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e6732652-d36b-4347-96d3-6a9f8b15e2da tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:45.399314 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e6732652-d36b-4347-96d3-6a9f8b15e2da tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:45.400016 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e6732652-d36b-4347-96d3-6a9f8b15e2da tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:45.561250 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-e6732652-d36b-4347-96d3-6a9f8b15e2da tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:45.570668 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e6732652-d36b-4347-96d3-6a9f8b15e2da tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1595 microversion: 2.1 time: 0.184993 Jun 30 16:43:45.571185 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 575/1121] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:45 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1595 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:46.121684 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-65c52595-ef1d-4c43-8cfd-7982094fc11d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:46.122922 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-65c52595-ef1d-4c43-8cfd-7982094fc11d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:46.132757 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-65c52595-ef1d-4c43-8cfd-7982094fc11d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:46.133211 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-65c52595-ef1d-4c43-8cfd-7982094fc11d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:46.133996 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-65c52595-ef1d-4c43-8cfd-7982094fc11d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:46.134742 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-65c52595-ef1d-4c43-8cfd-7982094fc11d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:46.304377 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-65c52595-ef1d-4c43-8cfd-7982094fc11d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:46.320954 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-65c52595-ef1d-4c43-8cfd-7982094fc11d tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1267 microversion: 2.1 time: 0.202880 Jun 30 16:43:46.322395 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 547/1122] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:46 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:47.338971 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-dc6da788-977a-4da7-bdb6-0e6bf68b0f66 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:47.340383 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-dc6da788-977a-4da7-bdb6-0e6bf68b0f66 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:47.353429 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dc6da788-977a-4da7-bdb6-0e6bf68b0f66 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:47.355090 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dc6da788-977a-4da7-bdb6-0e6bf68b0f66 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:47.356804 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dc6da788-977a-4da7-bdb6-0e6bf68b0f66 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:47.358775 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-dc6da788-977a-4da7-bdb6-0e6bf68b0f66 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:47.382549 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-8b8a515e-0805-48a0-8396-ca9555be598a req-6e697710-c0fd-4a35-9e6b-55b239cc41a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cef79c1-fa15-4e49-8321-cc34f0fb26d4", "name": "network-vif-plugged", "status": "completed", "tag": "f851ca38-1a08-4d45-b314-d75329a56f1b"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:43:47.391225 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-8b8a515e-0805-48a0-8396-ca9555be598a req-6e697710-c0fd-4a35-9e6b-55b239cc41a3 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:47.391713 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-8b8a515e-0805-48a0-8396-ca9555be598a req-6e697710-c0fd-4a35-9e6b-55b239cc41a3 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:47.404821 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-8b8a515e-0805-48a0-8396-ca9555be598a req-6e697710-c0fd-4a35-9e6b-55b239cc41a3 service nova] Creating event network-vif-plugged:f851ca38-1a08-4d45-b314-d75329a56f1b for instance 6cef79c1-fa15-4e49-8321-cc34f0fb26d4 on hv-cinder-83602 Jun 30 16:43:47.413099 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-8b8a515e-0805-48a0-8396-ca9555be598a req-6e697710-c0fd-4a35-9e6b-55b239cc41a3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034896 Jun 30 16:43:47.419003 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 548/1123] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:43:47.573145 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-dc6da788-977a-4da7-bdb6-0e6bf68b0f66 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:47.583372 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-dc6da788-977a-4da7-bdb6-0e6bf68b0f66 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1267 microversion: 2.1 time: 0.248919 Jun 30 16:43:47.590995 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 576/1124] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:47 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1267 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:48.613410 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8824e61c-7391-43ac-8fc6-69b78af0a5aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:48.615279 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8824e61c-7391-43ac-8fc6-69b78af0a5aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:48.628481 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8824e61c-7391-43ac-8fc6-69b78af0a5aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:48.630605 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8824e61c-7391-43ac-8fc6-69b78af0a5aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:48.631434 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8824e61c-7391-43ac-8fc6-69b78af0a5aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:48.631923 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8824e61c-7391-43ac-8fc6-69b78af0a5aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:48.825106 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-35d768bf-aec2-45ab-a1ba-3b7b6fa3a377 req-7ca341fe-141a-4a07-a4e2-f55449f02a1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eebf23b5-45ea-41d1-a9f5-c8cb4fa09225", "tag": "8a69fd47-714b-49b4-a300-c1c75c143774"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:43:48.843429 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-35d768bf-aec2-45ab-a1ba-3b7b6fa3a377 req-7ca341fe-141a-4a07-a4e2-f55449f02a1c service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:48.848783 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-35d768bf-aec2-45ab-a1ba-3b7b6fa3a377 req-7ca341fe-141a-4a07-a4e2-f55449f02a1c service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:48.889335 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-35d768bf-aec2-45ab-a1ba-3b7b6fa3a377 req-7ca341fe-141a-4a07-a4e2-f55449f02a1c service nova] Creating event network-changed:8a69fd47-714b-49b4-a300-c1c75c143774 for instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 on hv-cinder-83602 Jun 30 16:43:48.912570 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-35d768bf-aec2-45ab-a1ba-3b7b6fa3a377 req-7ca341fe-141a-4a07-a4e2-f55449f02a1c service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107449 Jun 30 16:43:48.913704 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 577/1125] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:43:49.208804 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8824e61c-7391-43ac-8fc6-69b78af0a5aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:49.217349 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8824e61c-7391-43ac-8fc6-69b78af0a5aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1267 microversion: 2.1 time: 0.620085 Jun 30 16:43:49.217882 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 549/1126] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:48 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1267 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:50.236338 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-036200ac-ab51-4365-a7c5-a10e31b37a33 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:50.238441 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-036200ac-ab51-4365-a7c5-a10e31b37a33 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:50.245467 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-036200ac-ab51-4365-a7c5-a10e31b37a33 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:50.246023 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-036200ac-ab51-4365-a7c5-a10e31b37a33 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:50.246876 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-036200ac-ab51-4365-a7c5-a10e31b37a33 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:50.247318 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-036200ac-ab51-4365-a7c5-a10e31b37a33 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:50.612738 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-036200ac-ab51-4365-a7c5-a10e31b37a33 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:50.620540 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-036200ac-ab51-4365-a7c5-a10e31b37a33 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1453 microversion: 2.1 time: 0.389071 Jun 30 16:43:50.621114 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 578/1127] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:50 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1453 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:50.637952 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-9a278955-3f57-4f60-84a3-d71c72a73b15 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:50.638568 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-9a278955-3f57-4f60-84a3-d71c72a73b15 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:50.645420 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9a278955-3f57-4f60-84a3-d71c72a73b15 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:50.645872 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9a278955-3f57-4f60-84a3-d71c72a73b15 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:50.646640 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9a278955-3f57-4f60-84a3-d71c72a73b15 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:50.647079 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-9a278955-3f57-4f60-84a3-d71c72a73b15 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:50.782538 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-9a278955-3f57-4f60-84a3-d71c72a73b15 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:50.791933 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-9a278955-3f57-4f60-84a3-d71c72a73b15 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1453 microversion: 2.1 time: 0.157722 Jun 30 16:43:50.792504 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 550/1128] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:50 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:43:52.876364 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-03307698-8085-4ecc-869f-b4cf75ba9943 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-297854854"}} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:43:52.877961 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-03307698-8085-4ecc-869f-b4cf75ba9943 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:52.884859 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-03307698-8085-4ecc-869f-b4cf75ba9943 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:52.885390 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-03307698-8085-4ecc-869f-b4cf75ba9943 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:52.886229 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-03307698-8085-4ecc-869f-b4cf75ba9943 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:52.886664 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-03307698-8085-4ecc-869f-b4cf75ba9943 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:53.110532 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.network.security_group_api [None req-03307698-8085-4ecc-869f-b4cf75ba9943 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Adding security group 4abfeacb-a959-44ad-95d1-2fc26e7b1394 to port 8a69fd47-714b-49b4-a300-c1c75c143774 Jun 30 16:43:53.695670 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-c0ffc21d-dfae-4cca-860f-edf4e40d6a61 req-721d6dfc-7f2f-4c34-b762-4bdf89e8407b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cef79c1-fa15-4e49-8321-cc34f0fb26d4", "tag": "f851ca38-1a08-4d45-b314-d75329a56f1b"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:43:53.705194 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-c0ffc21d-dfae-4cca-860f-edf4e40d6a61 req-721d6dfc-7f2f-4c34-b762-4bdf89e8407b service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:53.706542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-c0ffc21d-dfae-4cca-860f-edf4e40d6a61 req-721d6dfc-7f2f-4c34-b762-4bdf89e8407b service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:53.720209 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-c0ffc21d-dfae-4cca-860f-edf4e40d6a61 req-721d6dfc-7f2f-4c34-b762-4bdf89e8407b service nova] Creating event network-changed:f851ca38-1a08-4d45-b314-d75329a56f1b for instance 6cef79c1-fa15-4e49-8321-cc34f0fb26d4 on hv-cinder-83602 Jun 30 16:43:53.726156 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-c0ffc21d-dfae-4cca-860f-edf4e40d6a61 req-721d6dfc-7f2f-4c34-b762-4bdf89e8407b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035988 Jun 30 16:43:53.726768 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 551/1129] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:43:53.804522 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-03307698-8085-4ecc-869f-b4cf75ba9943 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "POST /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/action" status: 202 len: 0 microversion: 2.1 time: 0.932013 Jun 30 16:43:53.805138 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 579/1130] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 30 16:43:52 2022] POST /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/action => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 30 16:43:53.816092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1452edf3-1762-4b9f-a984-5b5f8666b118 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:43:53.816926 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-1452edf3-1762-4b9f-a984-5b5f8666b118 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:43:53.829720 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1452edf3-1762-4b9f-a984-5b5f8666b118 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:53.831453 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1452edf3-1762-4b9f-a984-5b5f8666b118 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:53.835463 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1452edf3-1762-4b9f-a984-5b5f8666b118 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:53.836291 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1452edf3-1762-4b9f-a984-5b5f8666b118 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:54.092195 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-1452edf3-1762-4b9f-a984-5b5f8666b118 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:43:54.101909 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-1452edf3-1762-4b9f-a984-5b5f8666b118 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1759 microversion: 2.1 time: 0.291530 Jun 30 16:43:54.117209 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 552/1131] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:43:53 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1759 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:43:55.742472 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-8853fe83-4f9c-4477-80ef-76a2ce095b9a req-eebec2d2-81be-40a2-8fec-804f366dd77e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eebf23b5-45ea-41d1-a9f5-c8cb4fa09225", "tag": "8a69fd47-714b-49b4-a300-c1c75c143774"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:43:55.750703 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-8853fe83-4f9c-4477-80ef-76a2ce095b9a req-eebec2d2-81be-40a2-8fec-804f366dd77e service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:43:55.751155 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-8853fe83-4f9c-4477-80ef-76a2ce095b9a req-eebec2d2-81be-40a2-8fec-804f366dd77e service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:43:55.762557 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-8853fe83-4f9c-4477-80ef-76a2ce095b9a req-eebec2d2-81be-40a2-8fec-804f366dd77e service nova] Creating event network-changed:8a69fd47-714b-49b4-a300-c1c75c143774 for instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 on hv-cinder-83602 Jun 30 16:43:55.768253 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-8853fe83-4f9c-4477-80ef-76a2ce095b9a req-eebec2d2-81be-40a2-8fec-804f366dd77e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029459 Jun 30 16:43:55.768906 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 580/1132] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:44:06.092663 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-23294cae-ac1a-4bfc-9f2f-a73f0eb51300 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:44:06.093678 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-23294cae-ac1a-4bfc-9f2f-a73f0eb51300 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:06.096349 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=35 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:44:06.097003 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=39 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:44:06.102857 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-23294cae-ac1a-4bfc-9f2f-a73f0eb51300 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:06.103309 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-23294cae-ac1a-4bfc-9f2f-a73f0eb51300 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:06.104126 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-23294cae-ac1a-4bfc-9f2f-a73f0eb51300 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:06.104576 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-23294cae-ac1a-4bfc-9f2f-a73f0eb51300 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:06.440847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-23294cae-ac1a-4bfc-9f2f-a73f0eb51300 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "POST /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/action" status: 202 len: 0 microversion: 2.1 time: 0.352033 Jun 30 16:44:06.441490 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 553/1133] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 30 16:44:06 2022] POST /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:44:06.448236 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=25 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:44:06.449106 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=45 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:44:06.453421 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ada18c80-c08d-4ca5-a869-0650c0097107 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:06.454180 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-ada18c80-c08d-4ca5-a869-0650c0097107 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:06.460513 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ada18c80-c08d-4ca5-a869-0650c0097107 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:06.461134 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ada18c80-c08d-4ca5-a869-0650c0097107 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:06.461922 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ada18c80-c08d-4ca5-a869-0650c0097107 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:06.462427 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-ada18c80-c08d-4ca5-a869-0650c0097107 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:06.612430 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-ada18c80-c08d-4ca5-a869-0650c0097107 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:06.621707 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ada18c80-c08d-4ca5-a869-0650c0097107 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1751 microversion: 2.1 time: 0.174867 Jun 30 16:44:06.622299 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 581/1134] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:06 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:44:07.642721 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-bb7b1a5e-a095-4cb4-bd58-58de45464c45 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:07.643521 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-bb7b1a5e-a095-4cb4-bd58-58de45464c45 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:07.650562 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bb7b1a5e-a095-4cb4-bd58-58de45464c45 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:07.651011 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bb7b1a5e-a095-4cb4-bd58-58de45464c45 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:07.651807 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bb7b1a5e-a095-4cb4-bd58-58de45464c45 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:07.652238 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-bb7b1a5e-a095-4cb4-bd58-58de45464c45 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:07.800149 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-bb7b1a5e-a095-4cb4-bd58-58de45464c45 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:07.809542 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-bb7b1a5e-a095-4cb4-bd58-58de45464c45 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.171719 Jun 30 16:44:07.810124 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 554/1135] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:07 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:08.827161 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-fd295ecd-3a1d-4e9b-b742-89842d484f16 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:08.827830 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-fd295ecd-3a1d-4e9b-b742-89842d484f16 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:08.835234 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fd295ecd-3a1d-4e9b-b742-89842d484f16 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:08.840133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fd295ecd-3a1d-4e9b-b742-89842d484f16 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:08.840133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fd295ecd-3a1d-4e9b-b742-89842d484f16 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:08.840133 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fd295ecd-3a1d-4e9b-b742-89842d484f16 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:08.990018 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-fd295ecd-3a1d-4e9b-b742-89842d484f16 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:08.998199 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-fd295ecd-3a1d-4e9b-b742-89842d484f16 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.175014 Jun 30 16:44:08.998778 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 582/1136] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:08 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:10.015907 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-8680aa9a-5f16-4845-8f22-e1971213c8e4 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:10.016566 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-8680aa9a-5f16-4845-8f22-e1971213c8e4 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:10.023161 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8680aa9a-5f16-4845-8f22-e1971213c8e4 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:10.023665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8680aa9a-5f16-4845-8f22-e1971213c8e4 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:10.024440 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8680aa9a-5f16-4845-8f22-e1971213c8e4 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:10.024882 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-8680aa9a-5f16-4845-8f22-e1971213c8e4 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:10.172130 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-8680aa9a-5f16-4845-8f22-e1971213c8e4 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:10.180100 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-8680aa9a-5f16-4845-8f22-e1971213c8e4 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.168252 Jun 30 16:44:10.180661 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 555/1137] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:10 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:11.198382 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-36fdbb02-223a-4f08-97ed-dec8d578b949 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:11.199425 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-36fdbb02-223a-4f08-97ed-dec8d578b949 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:11.206260 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-36fdbb02-223a-4f08-97ed-dec8d578b949 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:11.206809 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-36fdbb02-223a-4f08-97ed-dec8d578b949 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:11.207605 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-36fdbb02-223a-4f08-97ed-dec8d578b949 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:11.208040 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-36fdbb02-223a-4f08-97ed-dec8d578b949 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:11.370491 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-36fdbb02-223a-4f08-97ed-dec8d578b949 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:11.379081 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-36fdbb02-223a-4f08-97ed-dec8d578b949 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.184761 Jun 30 16:44:11.379693 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 583/1138] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:11 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:12.397317 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4ce88328-8467-4105-83ea-c34448e23691 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:12.397960 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4ce88328-8467-4105-83ea-c34448e23691 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:12.404287 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4ce88328-8467-4105-83ea-c34448e23691 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:12.404738 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4ce88328-8467-4105-83ea-c34448e23691 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:12.405506 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4ce88328-8467-4105-83ea-c34448e23691 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:12.405942 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4ce88328-8467-4105-83ea-c34448e23691 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:12.548062 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-4ce88328-8467-4105-83ea-c34448e23691 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:12.556047 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-4ce88328-8467-4105-83ea-c34448e23691 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.162506 Jun 30 16:44:12.556604 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 556/1139] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:12 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:13.574085 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-48266284-b463-4ee6-83d3-3018cba93427 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:13.574675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-48266284-b463-4ee6-83d3-3018cba93427 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:13.580826 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-48266284-b463-4ee6-83d3-3018cba93427 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:13.581275 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-48266284-b463-4ee6-83d3-3018cba93427 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:13.582041 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-48266284-b463-4ee6-83d3-3018cba93427 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:13.582479 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-48266284-b463-4ee6-83d3-3018cba93427 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:13.736124 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-48266284-b463-4ee6-83d3-3018cba93427 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:13.744383 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-48266284-b463-4ee6-83d3-3018cba93427 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.174730 Jun 30 16:44:13.745037 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 584/1140] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:13 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:14.761485 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1ae311f9-13bd-4a7e-a316-dab44b5226cc tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:14.763067 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-1ae311f9-13bd-4a7e-a316-dab44b5226cc tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:14.770438 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1ae311f9-13bd-4a7e-a316-dab44b5226cc tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:14.770893 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1ae311f9-13bd-4a7e-a316-dab44b5226cc tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:14.771784 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1ae311f9-13bd-4a7e-a316-dab44b5226cc tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:14.772162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1ae311f9-13bd-4a7e-a316-dab44b5226cc tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:14.922482 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-1ae311f9-13bd-4a7e-a316-dab44b5226cc tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:14.930656 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-1ae311f9-13bd-4a7e-a316-dab44b5226cc tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.173006 Jun 30 16:44:14.931504 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 557/1141] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:14 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:15.948906 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-03775ea6-df70-44ef-a3f7-fcd1c6a78862 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:15.949549 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-03775ea6-df70-44ef-a3f7-fcd1c6a78862 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:15.956513 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-03775ea6-df70-44ef-a3f7-fcd1c6a78862 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:15.956966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-03775ea6-df70-44ef-a3f7-fcd1c6a78862 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:15.957736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-03775ea6-df70-44ef-a3f7-fcd1c6a78862 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:15.958184 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-03775ea6-df70-44ef-a3f7-fcd1c6a78862 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:16.104705 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-03775ea6-df70-44ef-a3f7-fcd1c6a78862 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:16.113614 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-03775ea6-df70-44ef-a3f7-fcd1c6a78862 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.168648 Jun 30 16:44:16.113924 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 585/1142] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:15 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:17.130377 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-c63f278c-ed62-4e71-b032-1bcda698c537 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:17.131010 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-c63f278c-ed62-4e71-b032-1bcda698c537 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:17.137786 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c63f278c-ed62-4e71-b032-1bcda698c537 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:17.138399 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c63f278c-ed62-4e71-b032-1bcda698c537 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:17.139172 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c63f278c-ed62-4e71-b032-1bcda698c537 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:17.139749 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-c63f278c-ed62-4e71-b032-1bcda698c537 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:17.295450 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-c63f278c-ed62-4e71-b032-1bcda698c537 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:17.303559 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-c63f278c-ed62-4e71-b032-1bcda698c537 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.177144 Jun 30 16:44:17.304128 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 558/1143] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:17 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:18.321627 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-44b230eb-3604-4501-9b55-0e85c2147378 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:18.322255 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-44b230eb-3604-4501-9b55-0e85c2147378 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:18.329225 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-44b230eb-3604-4501-9b55-0e85c2147378 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:18.329673 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-44b230eb-3604-4501-9b55-0e85c2147378 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:18.330435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-44b230eb-3604-4501-9b55-0e85c2147378 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:18.330902 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-44b230eb-3604-4501-9b55-0e85c2147378 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:18.474842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-44b230eb-3604-4501-9b55-0e85c2147378 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:18.483651 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-44b230eb-3604-4501-9b55-0e85c2147378 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.166111 Jun 30 16:44:18.484216 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 586/1144] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:18 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:19.502441 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-60de7d40-814a-4b74-8e05-51daea41b022 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:19.502993 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-60de7d40-814a-4b74-8e05-51daea41b022 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:19.509515 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-60de7d40-814a-4b74-8e05-51daea41b022 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:19.509966 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-60de7d40-814a-4b74-8e05-51daea41b022 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:19.510734 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-60de7d40-814a-4b74-8e05-51daea41b022 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:19.511174 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-60de7d40-814a-4b74-8e05-51daea41b022 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:19.659192 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-60de7d40-814a-4b74-8e05-51daea41b022 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:19.667213 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-60de7d40-814a-4b74-8e05-51daea41b022 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.169694 Jun 30 16:44:19.667811 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 559/1145] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:19 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:20.685410 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-2ead4483-db78-4a9e-967c-14b359bf6486 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:20.686055 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-2ead4483-db78-4a9e-967c-14b359bf6486 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:20.694389 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2ead4483-db78-4a9e-967c-14b359bf6486 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:20.694828 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2ead4483-db78-4a9e-967c-14b359bf6486 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:20.695869 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2ead4483-db78-4a9e-967c-14b359bf6486 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:20.696302 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-2ead4483-db78-4a9e-967c-14b359bf6486 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:20.843330 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-2ead4483-db78-4a9e-967c-14b359bf6486 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:20.851955 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-2ead4483-db78-4a9e-967c-14b359bf6486 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.170689 Jun 30 16:44:20.852533 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 587/1146] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:20 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:21.869276 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-cbeed1bf-0721-4da9-87bc-77d56b94a0f1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:21.869886 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-cbeed1bf-0721-4da9-87bc-77d56b94a0f1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:21.877005 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cbeed1bf-0721-4da9-87bc-77d56b94a0f1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:21.877495 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cbeed1bf-0721-4da9-87bc-77d56b94a0f1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:21.878280 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cbeed1bf-0721-4da9-87bc-77d56b94a0f1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:21.878714 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-cbeed1bf-0721-4da9-87bc-77d56b94a0f1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:22.025186 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-cbeed1bf-0721-4da9-87bc-77d56b94a0f1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:22.034312 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-cbeed1bf-0721-4da9-87bc-77d56b94a0f1 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.169010 Jun 30 16:44:22.034865 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 560/1147] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:21 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:23.052381 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6f37ad96-10f3-4fe9-972f-1a2ca1d50344 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:23.053016 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6f37ad96-10f3-4fe9-972f-1a2ca1d50344 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:23.059579 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6f37ad96-10f3-4fe9-972f-1a2ca1d50344 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:23.060052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6f37ad96-10f3-4fe9-972f-1a2ca1d50344 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:23.060826 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6f37ad96-10f3-4fe9-972f-1a2ca1d50344 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:23.061267 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6f37ad96-10f3-4fe9-972f-1a2ca1d50344 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:23.211451 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6f37ad96-10f3-4fe9-972f-1a2ca1d50344 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:23.220671 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6f37ad96-10f3-4fe9-972f-1a2ca1d50344 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.172017 Jun 30 16:44:23.221249 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 588/1148] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:23 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:24.238848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f7622f54-1362-458b-af8c-8fa6d7e2b246 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:24.239582 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f7622f54-1362-458b-af8c-8fa6d7e2b246 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:24.246186 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f7622f54-1362-458b-af8c-8fa6d7e2b246 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:24.246660 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f7622f54-1362-458b-af8c-8fa6d7e2b246 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:24.247435 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f7622f54-1362-458b-af8c-8fa6d7e2b246 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:24.247898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f7622f54-1362-458b-af8c-8fa6d7e2b246 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:24.394162 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-f7622f54-1362-458b-af8c-8fa6d7e2b246 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:24.402270 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f7622f54-1362-458b-af8c-8fa6d7e2b246 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1756 microversion: 2.1 time: 0.167343 Jun 30 16:44:24.402777 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 561/1149] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:24 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:25.419927 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-130c28e2-047e-4800-b277-336401e8efb2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:44:25.420540 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-130c28e2-047e-4800-b277-336401e8efb2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:25.427271 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-130c28e2-047e-4800-b277-336401e8efb2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:25.427799 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-130c28e2-047e-4800-b277-336401e8efb2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:25.428657 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-130c28e2-047e-4800-b277-336401e8efb2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:25.429148 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-130c28e2-047e-4800-b277-336401e8efb2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:25.576762 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-130c28e2-047e-4800-b277-336401e8efb2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:44:25.585033 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-130c28e2-047e-4800-b277-336401e8efb2 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1759 microversion: 2.1 time: 0.168923 Jun 30 16:44:25.585600 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 589/1150] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:44:25 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1759 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:44:58.065223 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-35ef7e76-6786-43b5-87c1-fe047eafaf67 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-297854854"}} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:44:58.065848 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-35ef7e76-6786-43b5-87c1-fe047eafaf67 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:44:58.068579 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=18 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:44:58.069305 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:44:58.075000 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-35ef7e76-6786-43b5-87c1-fe047eafaf67 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:58.075456 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-35ef7e76-6786-43b5-87c1-fe047eafaf67 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:58.076256 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-35ef7e76-6786-43b5-87c1-fe047eafaf67 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:58.076700 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-35ef7e76-6786-43b5-87c1-fe047eafaf67 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:58.209561 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.network.security_group_api [None req-35ef7e76-6786-43b5-87c1-fe047eafaf67 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Removing security group 4abfeacb-a959-44ad-95d1-2fc26e7b1394 from port 8a69fd47-714b-49b4-a300-c1c75c143774 Jun 30 16:44:58.610657 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-35ef7e76-6786-43b5-87c1-fe047eafaf67 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "POST /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/action" status: 202 len: 0 microversion: 2.1 time: 0.549258 Jun 30 16:44:58.615101 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 562/1151] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 30 16:44:58 2022] POST /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:44:58.624150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=18 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:44:58.630736 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=54 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:44:58.880956 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [req-345667e8-ced6-489b-8391-532e706b3445 req-a435dec9-8815-478a-9b2c-da4f77a12b21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eebf23b5-45ea-41d1-a9f5-c8cb4fa09225", "tag": "8a69fd47-714b-49b4-a300-c1c75c143774"}]} {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:44:58.889481 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-345667e8-ced6-489b-8391-532e706b3445 req-a435dec9-8815-478a-9b2c-da4f77a12b21 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:44:58.889812 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [req-345667e8-ced6-489b-8391-532e706b3445 req-a435dec9-8815-478a-9b2c-da4f77a12b21 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:44:58.901524 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.compute.server_external_events [req-345667e8-ced6-489b-8391-532e706b3445 req-a435dec9-8815-478a-9b2c-da4f77a12b21 service nova] Creating event network-changed:8a69fd47-714b-49b4-a300-c1c75c143774 for instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 on hv-cinder-83602 Jun 30 16:44:58.906667 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [req-345667e8-ced6-489b-8391-532e706b3445 req-a435dec9-8815-478a-9b2c-da4f77a12b21 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.288244 Jun 30 16:44:58.907660 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 590/1152] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:45:00.098592 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-f42e224d-ebdb-4852-82ea-3d7fc97242e5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:00.099174 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-f42e224d-ebdb-4852-82ea-3d7fc97242e5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:00.105359 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f42e224d-ebdb-4852-82ea-3d7fc97242e5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:00.105813 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f42e224d-ebdb-4852-82ea-3d7fc97242e5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:00.107650 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f42e224d-ebdb-4852-82ea-3d7fc97242e5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:00.108400 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-f42e224d-ebdb-4852-82ea-3d7fc97242e5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:00.204260 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.objects.instance [None req-f42e224d-ebdb-4852-82ea-3d7fc97242e5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lazy-loading 'services' on Instance uuid eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 {{(pid=124814) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 30 16:45:00.453229 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-f42e224d-ebdb-4852-82ea-3d7fc97242e5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "DELETE /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/os-volume_attachments/56aacffe-9f52-4586-b91a-fdb1aa76a885" status: 202 len: 0 microversion: 2.1 time: 0.359232 Jun 30 16:45:00.453889 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 563/1153] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 30 16:45:00 2022] DELETE /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/os-volume_attachments/56aacffe-9f52-4586-b91a-fdb1aa76a885 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:45:00.463829 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-21e11460-e811-4df5-9c08-689496e20aaf tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:00.464852 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-21e11460-e811-4df5-9c08-689496e20aaf tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:00.471438 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-21e11460-e811-4df5-9c08-689496e20aaf tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:00.471929 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-21e11460-e811-4df5-9c08-689496e20aaf tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:00.472712 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-21e11460-e811-4df5-9c08-689496e20aaf tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:00.473235 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-21e11460-e811-4df5-9c08-689496e20aaf tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:00.510740 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-21e11460-e811-4df5-9c08-689496e20aaf tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051889 Jun 30 16:45:00.511244 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 591/1154] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:45:00 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:45:00.937097 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-b5e8d797-af00-4c5c-947e-af3e10174ed2 req-03fc087f-d381-4a71-89af-9f77db7c7ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eebf23b5-45ea-41d1-a9f5-c8cb4fa09225", "tag": "8a69fd47-714b-49b4-a300-c1c75c143774"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:45:00.945335 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-b5e8d797-af00-4c5c-947e-af3e10174ed2 req-03fc087f-d381-4a71-89af-9f77db7c7ff0 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:00.945771 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-b5e8d797-af00-4c5c-947e-af3e10174ed2 req-03fc087f-d381-4a71-89af-9f77db7c7ff0 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:00.958017 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-b5e8d797-af00-4c5c-947e-af3e10174ed2 req-03fc087f-d381-4a71-89af-9f77db7c7ff0 service nova] Creating event network-changed:8a69fd47-714b-49b4-a300-c1c75c143774 for instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 on hv-cinder-83602 Jun 30 16:45:00.963188 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-b5e8d797-af00-4c5c-947e-af3e10174ed2 req-03fc087f-d381-4a71-89af-9f77db7c7ff0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030374 Jun 30 16:45:00.964155 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 564/1155] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:45:01.523417 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-e7e5e48f-475a-4b3b-81c5-bc94f8b5c4bb tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:01.524408 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-e7e5e48f-475a-4b3b-81c5-bc94f8b5c4bb tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:01.530963 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e7e5e48f-475a-4b3b-81c5-bc94f8b5c4bb tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:01.531462 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e7e5e48f-475a-4b3b-81c5-bc94f8b5c4bb tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:01.532263 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e7e5e48f-475a-4b3b-81c5-bc94f8b5c4bb tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:01.532706 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-e7e5e48f-475a-4b3b-81c5-bc94f8b5c4bb tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:01.561020 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-e7e5e48f-475a-4b3b-81c5-bc94f8b5c4bb tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042157 Jun 30 16:45:01.561587 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 592/1156] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 30 16:45:01 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 30 16:45:01.573353 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0693c16f-b1e8-4504-afa1-6f4361a72640 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:01.573940 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-0693c16f-b1e8-4504-afa1-6f4361a72640 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:01.580139 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0693c16f-b1e8-4504-afa1-6f4361a72640 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:01.580593 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0693c16f-b1e8-4504-afa1-6f4361a72640 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:01.581363 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0693c16f-b1e8-4504-afa1-6f4361a72640 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:01.581805 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-0693c16f-b1e8-4504-afa1-6f4361a72640 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:01.659197 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-0693c16f-b1e8-4504-afa1-6f4361a72640 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] HTTP exception thrown: Instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 is not attached to volume 56aacffe-9f52-4586-b91a-fdb1aa76a885 Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0693c16f-b1e8-4504-afa1-6f4361a72640 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Request method failure captured: Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: DELETE /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/os-volume_attachments/56aacffe-9f52-4586-b91a-fdb1aa76a885 HTTP/1.1 Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdJ2Sx2gPz3NWHsjjOxscPFN8laQba2KIk4T5DzN2VV6FtX09U96fI5M1AzTSAHiAfSLmwv20Fx3w1W9ysi8ziUs7pP4fgZnRtLXOfTO9ej6HFCHzq-oXtS1LvX1fIbahpesWY0lNQfCeo4wefpnwd_1X4B6Rz5tcC3upUGV-nVVsug Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: ce9b910eae974562929f660ba8c7af4c Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-TestMinimumBasicScenario-670120727 Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:45:01.670751 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:45:01.672800 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ce9b910eae974562929f660ba8c7af4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ce9b910eae974562929f660ba8c7af4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ce9b910eae974562929f660ba8c7af4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ce9b910eae974562929f660ba8c7af4c"}]}] Jun 30 16:45:01.672800 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-TestMinimumBasicScenario-670120727 Jun 30 16:45:01.672800 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: ce9b910eae974562929f660ba8c7af4c Jun 30 16:45:01.672800 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-TestMinimumBasicScenario-670120727 Jun 30 16:45:01.672800 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-TestMinimumBasicScenario-670120727-project Jun 30 16:45:01.672800 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:45:01.672800 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:45:01.672800 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: 9c4e7816dc9c4eeab652534160c22757 Jun 30 16:45:01.672800 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-TestMinimumBasicScenario-670120727-project Jun 30 16:45:01.672800 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:45:01.672800 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 is not attached to volume 56aacffe-9f52-4586-b91a-fdb1aa76a885 Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'server_id': 'eebf23b5-45ea-41d1-a9f5-c8cb4fa09225', 'id': '56aacffe-9f52-4586-b91a-fdb1aa76a885'} Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 56aacffe-9f52-4586-b91a-fdb1aa76a885. Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:45:01.673665 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 is not attached to volume 56aacffe-9f52-4586-b91a-fdb1aa76a885 Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 is not attached to volume 56aacffe-9f52-4586-b91a-fdb1aa76a885 Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:01.675022 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-0693c16f-b1e8-4504-afa1-6f4361a72640 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Returning 404 to user: Instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 is not attached to volume 56aacffe-9f52-4586-b91a-fdb1aa76a885 {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:45:01.676851 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-0693c16f-b1e8-4504-afa1-6f4361a72640 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "DELETE /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/os-volume_attachments/56aacffe-9f52-4586-b91a-fdb1aa76a885" status: 404 len: 154 microversion: 2.1 time: 0.103930 Jun 30 16:45:01.676851 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 565/1157] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 30 16:45:01 2022] DELETE /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225/os-volume_attachments/56aacffe-9f52-4586-b91a-fdb1aa76a885 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:45:02.956842 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-79a72d62-0592-4f4b-a50e-717caaa5420e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:02.957325 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-79a72d62-0592-4f4b-a50e-717caaa5420e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:02.963725 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-79a72d62-0592-4f4b-a50e-717caaa5420e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:02.964186 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-79a72d62-0592-4f4b-a50e-717caaa5420e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:02.964941 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-79a72d62-0592-4f4b-a50e-717caaa5420e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:02.965378 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-79a72d62-0592-4f4b-a50e-717caaa5420e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:02.990813 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-79a72d62-0592-4f4b-a50e-717caaa5420e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Going to try to terminate instance {{(pid=124815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:45:03.351270 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-79a72d62-0592-4f4b-a50e-717caaa5420e tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "DELETE /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 204 len: 0 microversion: 2.1 time: 0.397947 Jun 30 16:45:03.351880 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 593/1158] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:45:02 2022] DELETE /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:45:03.360233 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-3cd1c402-7796-48e9-bcc0-00896573905d tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:03.360850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-3cd1c402-7796-48e9-bcc0-00896573905d tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:03.367632 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3cd1c402-7796-48e9-bcc0-00896573905d tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:03.368092 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3cd1c402-7796-48e9-bcc0-00896573905d tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:03.368871 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3cd1c402-7796-48e9-bcc0-00896573905d tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:03.369314 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-3cd1c402-7796-48e9-bcc0-00896573905d tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:03.508267 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-3cd1c402-7796-48e9-bcc0-00896573905d tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:45:03.515722 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-3cd1c402-7796-48e9-bcc0-00896573905d tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1555 microversion: 2.1 time: 0.159386 Jun 30 16:45:03.516279 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 566/1159] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:45:03 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:45:04.534772 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-f255cf7b-f6dc-4a98-b787-d70e02f49017 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:04.536006 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-f255cf7b-f6dc-4a98-b787-d70e02f49017 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:04.542596 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f255cf7b-f6dc-4a98-b787-d70e02f49017 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:04.543049 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f255cf7b-f6dc-4a98-b787-d70e02f49017 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:04.543847 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f255cf7b-f6dc-4a98-b787-d70e02f49017 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:04.544286 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-f255cf7b-f6dc-4a98-b787-d70e02f49017 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:04.674682 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-f255cf7b-f6dc-4a98-b787-d70e02f49017 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:45:04.683016 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-f255cf7b-f6dc-4a98-b787-d70e02f49017 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1555 microversion: 2.1 time: 0.152496 Jun 30 16:45:04.683619 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 594/1160] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:45:04 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:45:05.701332 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-fafd29bb-6bbc-44bd-b834-ac1556389234 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:05.703741 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-fafd29bb-6bbc-44bd-b834-ac1556389234 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:05.711252 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fafd29bb-6bbc-44bd-b834-ac1556389234 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:05.711744 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fafd29bb-6bbc-44bd-b834-ac1556389234 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:05.712534 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fafd29bb-6bbc-44bd-b834-ac1556389234 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:05.712978 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-fafd29bb-6bbc-44bd-b834-ac1556389234 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:05.763612 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-209cbcf2-4090-4cb8-b663-6a1dc3d46c4a req-edbc9cd8-2a0c-4927-b96d-7130896315ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eebf23b5-45ea-41d1-a9f5-c8cb4fa09225", "name": "network-vif-deleted", "tag": "8a69fd47-714b-49b4-a300-c1c75c143774"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:45:05.772314 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-209cbcf2-4090-4cb8-b663-6a1dc3d46c4a req-edbc9cd8-2a0c-4927-b96d-7130896315ac service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:05.772763 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-209cbcf2-4090-4cb8-b663-6a1dc3d46c4a req-edbc9cd8-2a0c-4927-b96d-7130896315ac service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:05.777038 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-fafd29bb-6bbc-44bd-b834-ac1556389234 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c4e7816dc9c4eeab652534160c22757', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9b910eae974562929f660ba8c7af4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:45:05.784041 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-209cbcf2-4090-4cb8-b663-6a1dc3d46c4a req-edbc9cd8-2a0c-4927-b96d-7130896315ac service nova] Creating event network-vif-deleted:8a69fd47-714b-49b4-a300-c1c75c143774 for instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 on hv-cinder-83602 Jun 30 16:45:05.784689 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-fafd29bb-6bbc-44bd-b834-ac1556389234 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 200 len: 1513 microversion: 2.1 time: 0.087888 Jun 30 16:45:05.785312 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 595/1161] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:45:05 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 1513 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:45:05.789293 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-209cbcf2-4090-4cb8-b663-6a1dc3d46c4a req-edbc9cd8-2a0c-4927-b96d-7130896315ac service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097429 Jun 30 16:45:05.789869 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 567/1162] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:45:06.802986 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b623a806-e500-4785-ba7d-61f8d037a7a5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:06.803650 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-b623a806-e500-4785-ba7d-61f8d037a7a5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [instance: eebf23b5-45ea-41d1-a9f5-c8cb4fa09225] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:06.810189 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b623a806-e500-4785-ba7d-61f8d037a7a5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:06.813762 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b623a806-e500-4785-ba7d-61f8d037a7a5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:06.813762 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b623a806-e500-4785-ba7d-61f8d037a7a5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:06.813762 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-b623a806-e500-4785-ba7d-61f8d037a7a5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:06.826640 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-b623a806-e500-4785-ba7d-61f8d037a7a5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] HTTP exception thrown: Instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 could not be found. Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b623a806-e500-4785-ba7d-61f8d037a7a5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Request method failure captured: Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 HTTP/1.1 Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdJ2Sx2gPz3NWHsjjOxscPFN8laQba2KIk4T5DzN2VV6FtX09U96fI5M1AzTSAHiAfSLmwv20Fx3w1W9ysi8ziUs7pP4fgZnRtLXOfTO9ej6HFCHzq-oXtS1LvX1fIbahpesWY0lNQfCeo4wefpnwd_1X4B6Rz5tcC3upUGV-nVVsug Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: ce9b910eae974562929f660ba8c7af4c Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-TestMinimumBasicScenario-670120727 Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:45:06.828301 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:45:06.829930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ce9b910eae974562929f660ba8c7af4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/ce9b910eae974562929f660ba8c7af4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_ce9b910eae974562929f660ba8c7af4c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/ce9b910eae974562929f660ba8c7af4c"}]}] Jun 30 16:45:06.829930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-TestMinimumBasicScenario-670120727 Jun 30 16:45:06.829930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: ce9b910eae974562929f660ba8c7af4c Jun 30 16:45:06.829930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-TestMinimumBasicScenario-670120727 Jun 30 16:45:06.829930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-TestMinimumBasicScenario-670120727-project Jun 30 16:45:06.829930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:45:06.829930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:45:06.829930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: 9c4e7816dc9c4eeab652534160c22757 Jun 30 16:45:06.829930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-TestMinimumBasicScenario-670120727-project Jun 30 16:45:06.829930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:45:06.829930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 could not be found. Jun 30 16:45:06.829930 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'eebf23b5-45ea-41d1-a9f5-c8cb4fa09225'} Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 could not be found. Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:45:06.830903 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 could not be found. Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 could not be found. Jun 30 16:45:06.833371 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:45:06.834966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-b623a806-e500-4785-ba7d-61f8d037a7a5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Returning 404 to user: Instance eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:45:06.834966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-b623a806-e500-4785-ba7d-61f8d037a7a5 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225" status: 404 len: 111 microversion: 2.1 time: 0.030732 Jun 30 16:45:06.834966 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 596/1163] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:45:06 2022] GET /compute/v2.1/servers/eebf23b5-45ea-41d1-a9f5-c8cb4fa09225 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:45:06.840564 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-781fad16-e878-46d7-8fa0-623ceb41e096 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] Calling method '.version_select at 0x7f38201e9430>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:06.843680 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR oslo.messaging._drivers.impl_rabbit [None req-781fad16-e878-46d7-8fa0-623ceb41e096 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [f3e7c3c5-c4ab-454c-930c-580b39fcbc63] AMQP server on 10.222.0.67:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 30 16:45:07.851855 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO oslo.messaging._drivers.impl_rabbit [None req-781fad16-e878-46d7-8fa0-623ceb41e096 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] [f3e7c3c5-c4ab-454c-930c-580b39fcbc63] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 46612. Jun 30 16:45:07.937654 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-781fad16-e878-46d7-8fa0-623ceb41e096 tempest-TestMinimumBasicScenario-670120727 tempest-TestMinimumBasicScenario-670120727-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1902677105" status: 202 len: 0 microversion: 2.1 time: 1.101789 Jun 30 16:45:07.938231 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 568/1164] 10.222.0.67 () {58 vars in 1271 bytes} [Thu Jun 30 16:45:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1902677105 => generated 0 bytes in 1103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:45:25.580245 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:45:25.580938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-c385a971-d39e-4a72-8d90-2d66a34a2ca2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:25.581403 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c385a971-d39e-4a72-8d90-2d66a34a2ca2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:25.581494 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG dbcounter [-] [124814] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=124814) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:45:25.583455 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:45:25.584162 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG dbcounter [-] [124815] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124815) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 16:45:25.586657 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-d8e0874f-29fc-4638-b2e2-36d5c7f0353a req-921146f7-643c-49ac-b5ed-bd59601396f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cef79c1-fa15-4e49-8321-cc34f0fb26d4", "tag": "f851ca38-1a08-4d45-b314-d75329a56f1b"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:45:25.589118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c385a971-d39e-4a72-8d90-2d66a34a2ca2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:25.589779 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c385a971-d39e-4a72-8d90-2d66a34a2ca2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:25.591032 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c385a971-d39e-4a72-8d90-2d66a34a2ca2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:25.591032 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-c385a971-d39e-4a72-8d90-2d66a34a2ca2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:25.597320 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-d8e0874f-29fc-4638-b2e2-36d5c7f0353a req-921146f7-643c-49ac-b5ed-bd59601396f0 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:25.597847 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-d8e0874f-29fc-4638-b2e2-36d5c7f0353a req-921146f7-643c-49ac-b5ed-bd59601396f0 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:25.609669 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-d8e0874f-29fc-4638-b2e2-36d5c7f0353a req-921146f7-643c-49ac-b5ed-bd59601396f0 service nova] Creating event network-changed:f851ca38-1a08-4d45-b314-d75329a56f1b for instance 6cef79c1-fa15-4e49-8321-cc34f0fb26d4 on hv-cinder-83602 Jun 30 16:45:25.615642 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-d8e0874f-29fc-4638-b2e2-36d5c7f0353a req-921146f7-643c-49ac-b5ed-bd59601396f0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036721 Jun 30 16:45:25.616716 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 569/1165] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:45:25.619981 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-c385a971-d39e-4a72-8d90-2d66a34a2ca2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Going to try to terminate instance {{(pid=124815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:45:25.945849 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-c385a971-d39e-4a72-8d90-2d66a34a2ca2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "DELETE /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 204 len: 0 microversion: 2.1 time: 0.368964 Jun 30 16:45:25.947409 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 597/1166] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:45:25 2022] DELETE /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:45:25.957464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-05cb948e-9519-47e2-8572-490a2370d9ef tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:25.958182 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-05cb948e-9519-47e2-8572-490a2370d9ef tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:25.966851 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-05cb948e-9519-47e2-8572-490a2370d9ef tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:25.967313 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-05cb948e-9519-47e2-8572-490a2370d9ef tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:25.968139 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-05cb948e-9519-47e2-8572-490a2370d9ef tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:25.968583 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-05cb948e-9519-47e2-8572-490a2370d9ef tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:26.112591 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-05cb948e-9519-47e2-8572-490a2370d9ef tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:45:26.120179 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-05cb948e-9519-47e2-8572-490a2370d9ef tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1577 microversion: 2.1 time: 0.167797 Jun 30 16:45:26.120749 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 570/1167] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:45:25 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:45:27.139096 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-8040bba5-baf9-4665-8cd3-695d59efe4aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:27.139860 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-8040bba5-baf9-4665-8cd3-695d59efe4aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:27.148227 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8040bba5-baf9-4665-8cd3-695d59efe4aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:27.148675 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8040bba5-baf9-4665-8cd3-695d59efe4aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:27.150108 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8040bba5-baf9-4665-8cd3-695d59efe4aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:27.150931 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-8040bba5-baf9-4665-8cd3-695d59efe4aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:27.296747 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-8040bba5-baf9-4665-8cd3-695d59efe4aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:45:27.304659 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-8040bba5-baf9-4665-8cd3-695d59efe4aa tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1577 microversion: 2.1 time: 0.170040 Jun 30 16:45:27.305219 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 598/1168] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:45:27 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:45:28.090117 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-70ea4dbf-a22e-4592-81e1-0228b6da4142 req-dd4ea512-1d4f-44a0-bff3-c2e4d13ac9dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cef79c1-fa15-4e49-8321-cc34f0fb26d4", "name": "network-vif-deleted", "tag": "f851ca38-1a08-4d45-b314-d75329a56f1b"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:45:28.098667 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-70ea4dbf-a22e-4592-81e1-0228b6da4142 req-dd4ea512-1d4f-44a0-bff3-c2e4d13ac9dd service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:28.099126 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-70ea4dbf-a22e-4592-81e1-0228b6da4142 req-dd4ea512-1d4f-44a0-bff3-c2e4d13ac9dd service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:28.110437 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-70ea4dbf-a22e-4592-81e1-0228b6da4142 req-dd4ea512-1d4f-44a0-bff3-c2e4d13ac9dd service nova] Creating event network-vif-deleted:f851ca38-1a08-4d45-b314-d75329a56f1b for instance 6cef79c1-fa15-4e49-8321-cc34f0fb26d4 on hv-cinder-83602 Jun 30 16:45:28.115199 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-70ea4dbf-a22e-4592-81e1-0228b6da4142 req-dd4ea512-1d4f-44a0-bff3-c2e4d13ac9dd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029258 Jun 30 16:45:28.116923 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 571/1169] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:45:28.322052 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-04b3a398-b833-4ed4-9335-3b123291eebf tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:28.322655 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-04b3a398-b833-4ed4-9335-3b123291eebf tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:28.329081 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-04b3a398-b833-4ed4-9335-3b123291eebf tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:28.329522 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-04b3a398-b833-4ed4-9335-3b123291eebf tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:28.330270 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-04b3a398-b833-4ed4-9335-3b123291eebf tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:28.330698 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-04b3a398-b833-4ed4-9335-3b123291eebf tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:28.394692 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-04b3a398-b833-4ed4-9335-3b123291eebf tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:45:28.402660 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-04b3a398-b833-4ed4-9335-3b123291eebf tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 200 len: 1226 microversion: 2.1 time: 0.084714 Jun 30 16:45:28.403249 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 599/1170] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:45:28 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:45:29.420261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4062369e-2c0c-4897-8feb-2346eee3fc76 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:29.420949 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-4062369e-2c0c-4897-8feb-2346eee3fc76 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 6cef79c1-fa15-4e49-8321-cc34f0fb26d4] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:29.427117 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4062369e-2c0c-4897-8feb-2346eee3fc76 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:29.427605 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4062369e-2c0c-4897-8feb-2346eee3fc76 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:29.428365 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4062369e-2c0c-4897-8feb-2346eee3fc76 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:29.429261 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-4062369e-2c0c-4897-8feb-2346eee3fc76 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:29.444812 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-4062369e-2c0c-4897-8feb-2346eee3fc76 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] HTTP exception thrown: Instance 6cef79c1-fa15-4e49-8321-cc34f0fb26d4 could not be found. Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4062369e-2c0c-4897-8feb-2346eee3fc76 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Request method failure captured: Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 HTTP/1.1 Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdFKSuL379510th7MRHxDO2Bx_XY-IYFkeUTjH0H_tMoqAwI_akvpTpYg9ei9xNz-CijIvdzVYPO4UIA3C8V3MsHSgkp7qfVdqGtxGOrN9LXxp2opb4DIxUhnRLOET4Lf0Nyj-8JkJlXhXr7Ua8wFhAMUVBTRMh5bddde8tbhNOLlMg Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 99847b649bfd4ca6a33cb2ea97ad0469 Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:45:29.448027 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:45:29.449850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/99847b649bfd4ca6a33cb2ea97ad0469"}]}] Jun 30 16:45:29.449850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:45:29.449850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 99847b649bfd4ca6a33cb2ea97ad0469 Jun 30 16:45:29.449850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:45:29.449850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-TestVolumeBootPattern-1904314065-project Jun 30 16:45:29.449850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:45:29.449850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:45:29.449850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: bb8a8a4e8b634322a92992379c98b721 Jun 30 16:45:29.449850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-TestVolumeBootPattern-1904314065-project Jun 30 16:45:29.449850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:45:29.449850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance 6cef79c1-fa15-4e49-8321-cc34f0fb26d4 could not be found. Jun 30 16:45:29.449850 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': '6cef79c1-fa15-4e49-8321-cc34f0fb26d4'} Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cef79c1-fa15-4e49-8321-cc34f0fb26d4 could not be found. Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:45:29.450973 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cef79c1-fa15-4e49-8321-cc34f0fb26d4 could not be found. Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cef79c1-fa15-4e49-8321-cc34f0fb26d4 could not be found. Jun 30 16:45:29.457221 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:29.459172 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-4062369e-2c0c-4897-8feb-2346eee3fc76 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Returning 404 to user: Instance 6cef79c1-fa15-4e49-8321-cc34f0fb26d4 could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:45:29.459172 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-4062369e-2c0c-4897-8feb-2346eee3fc76 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4" status: 404 len: 111 microversion: 2.1 time: 0.034640 Jun 30 16:45:29.459172 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 572/1171] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:45:29 2022] GET /compute/v2.1/servers/6cef79c1-fa15-4e49-8321-cc34f0fb26d4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:45:32.783294 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-54fe0475-2ff2-4abb-ac0e-bbd49de3d8f2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:32.794844 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-54fe0475-2ff2-4abb-ac0e-bbd49de3d8f2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:32.795005 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-c94f10c2-0f36-45c6-8bc1-4fd489b8a64a req-aae383e3-3f4a-4ce1-ba29-9304a701942b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b0e8c35-fb99-4b6f-9386-e1c2a73665cf", "tag": "9418a863-c50c-466a-a9fc-f7525b264d71"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:45:32.795505 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-54fe0475-2ff2-4abb-ac0e-bbd49de3d8f2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:32.795505 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-54fe0475-2ff2-4abb-ac0e-bbd49de3d8f2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:32.795505 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-54fe0475-2ff2-4abb-ac0e-bbd49de3d8f2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:32.795505 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-54fe0475-2ff2-4abb-ac0e-bbd49de3d8f2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:32.795862 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-c94f10c2-0f36-45c6-8bc1-4fd489b8a64a req-aae383e3-3f4a-4ce1-ba29-9304a701942b service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:32.795862 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-c94f10c2-0f36-45c6-8bc1-4fd489b8a64a req-aae383e3-3f4a-4ce1-ba29-9304a701942b service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:32.807854 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-c94f10c2-0f36-45c6-8bc1-4fd489b8a64a req-aae383e3-3f4a-4ce1-ba29-9304a701942b service nova] Creating event network-changed:9418a863-c50c-466a-a9fc-f7525b264d71 for instance 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf on hv-cinder-83602 Jun 30 16:45:32.813427 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-c94f10c2-0f36-45c6-8bc1-4fd489b8a64a req-aae383e3-3f4a-4ce1-ba29-9304a701942b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031478 Jun 30 16:45:32.814118 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 573/1172] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 30 16:45:32.828208 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-54fe0475-2ff2-4abb-ac0e-bbd49de3d8f2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Going to try to terminate instance {{(pid=124815) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 30 16:45:33.263271 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-54fe0475-2ff2-4abb-ac0e-bbd49de3d8f2 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 204 len: 0 microversion: 2.1 time: 0.483907 Jun 30 16:45:33.263987 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 600/1173] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:45:32 2022] DELETE /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 30 16:45:33.274444 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-49dbfed7-e357-46b2-8fcc-2a84bc38a130 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:33.275259 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-49dbfed7-e357-46b2-8fcc-2a84bc38a130 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:33.282854 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-49dbfed7-e357-46b2-8fcc-2a84bc38a130 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:33.283421 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-49dbfed7-e357-46b2-8fcc-2a84bc38a130 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:33.284260 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-49dbfed7-e357-46b2-8fcc-2a84bc38a130 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:33.284736 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-49dbfed7-e357-46b2-8fcc-2a84bc38a130 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:33.452567 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.policy [None req-49dbfed7-e357-46b2-8fcc-2a84bc38a130 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124814) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:45:33.460441 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-49dbfed7-e357-46b2-8fcc-2a84bc38a130 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1577 microversion: 2.1 time: 0.191249 Jun 30 16:45:33.461042 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 574/1174] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:45:33 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:45:34.478719 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-06640fe4-316f-436b-8908-fdad4f918569 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:34.480103 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-06640fe4-316f-436b-8908-fdad4f918569 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:34.486463 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-06640fe4-316f-436b-8908-fdad4f918569 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:34.486901 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-06640fe4-316f-436b-8908-fdad4f918569 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:34.487687 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-06640fe4-316f-436b-8908-fdad4f918569 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:34.488118 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-06640fe4-316f-436b-8908-fdad4f918569 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:34.622512 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-06640fe4-316f-436b-8908-fdad4f918569 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:45:34.630082 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-06640fe4-316f-436b-8908-fdad4f918569 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1459 microversion: 2.1 time: 0.155509 Jun 30 16:45:34.635677 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 601/1175] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:45:34 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1459 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 30 16:45:34.678804 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:45:34.679316 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Thu Jun 30 16:45:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 16:45:35.300165 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [req-4b5ea296-5f51-4dc0-958e-1703dc4f6d39 req-8fedfed1-9594-4a07-a4bf-e25d490d2be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b0e8c35-fb99-4b6f-9386-e1c2a73665cf", "name": "network-vif-deleted", "tag": "9418a863-c50c-466a-a9fc-f7525b264d71"}]} {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 30 16:45:35.310071 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-4b5ea296-5f51-4dc0-958e-1703dc4f6d39 req-8fedfed1-9594-4a07-a4bf-e25d490d2be2 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:35.310524 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [req-4b5ea296-5f51-4dc0-958e-1703dc4f6d39 req-8fedfed1-9594-4a07-a4bf-e25d490d2be2 service nova] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:35.320793 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.compute.server_external_events [req-4b5ea296-5f51-4dc0-958e-1703dc4f6d39 req-8fedfed1-9594-4a07-a4bf-e25d490d2be2 service nova] Creating event network-vif-deleted:9418a863-c50c-466a-a9fc-f7525b264d71 for instance 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf on hv-cinder-83602 Jun 30 16:45:35.326646 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [req-4b5ea296-5f51-4dc0-958e-1703dc4f6d39 req-8fedfed1-9594-4a07-a4bf-e25d490d2be2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030235 Jun 30 16:45:35.327217 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 575/1176] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 30 16:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 30 16:45:35.648204 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-6e12fd81-49d7-491f-ac2d-45d6aa819460 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:35.649435 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-6e12fd81-49d7-491f-ac2d-45d6aa819460 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:35.657576 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6e12fd81-49d7-491f-ac2d-45d6aa819460 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:35.658060 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6e12fd81-49d7-491f-ac2d-45d6aa819460 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:35.659149 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6e12fd81-49d7-491f-ac2d-45d6aa819460 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:35.659633 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-6e12fd81-49d7-491f-ac2d-45d6aa819460 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:35.732215 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.policy [None req-6e12fd81-49d7-491f-ac2d-45d6aa819460 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8a8a4e8b634322a92992379c98b721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99847b649bfd4ca6a33cb2ea97ad0469', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124815) authorize /opt/stack/nova/nova/policy.py:199}} Jun 30 16:45:35.737960 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-6e12fd81-49d7-491f-ac2d-45d6aa819460 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 200 len: 1225 microversion: 2.1 time: 0.093895 Jun 30 16:45:35.738530 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 602/1177] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:45:35 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 30 16:45:36.756876 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-68c5a58e-ee60-478b-afd0-9902308d0965 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:36.757504 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-68c5a58e-ee60-478b-afd0-9902308d0965 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:36.764590 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-68c5a58e-ee60-478b-afd0-9902308d0965 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:36.765046 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-68c5a58e-ee60-478b-afd0-9902308d0965 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:36.765820 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-68c5a58e-ee60-478b-afd0-9902308d0965 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:36.766399 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-68c5a58e-ee60-478b-afd0-9902308d0965 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:36.781413 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-68c5a58e-ee60-478b-afd0-9902308d0965 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] HTTP exception thrown: Instance 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf could not be found. Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-68c5a58e-ee60-478b-afd0-9902308d0965 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Request method failure captured: Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf HTTP/1.1 Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdFKSuL379510th7MRHxDO2Bx_XY-IYFkeUTjH0H_tMoqAwI_akvpTpYg9ei9xNz-CijIvdzVYPO4UIA3C8V3MsHSgkp7qfVdqGtxGOrN9LXxp2opb4DIxUhnRLOET4Lf0Nyj-8JkJlXhXr7Ua8wFhAMUVBTRMh5bddde8tbhNOLlMg Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 99847b649bfd4ca6a33cb2ea97ad0469 Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:45:36.783044 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:45:36.784782 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/99847b649bfd4ca6a33cb2ea97ad0469"}]}] Jun 30 16:45:36.784782 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:45:36.784782 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 99847b649bfd4ca6a33cb2ea97ad0469 Jun 30 16:45:36.784782 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:45:36.784782 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-TestVolumeBootPattern-1904314065-project Jun 30 16:45:36.784782 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:45:36.784782 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:45:36.784782 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: bb8a8a4e8b634322a92992379c98b721 Jun 30 16:45:36.784782 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-TestVolumeBootPattern-1904314065-project Jun 30 16:45:36.784782 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:45:36.784782 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf could not be found. Jun 30 16:45:36.784782 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': '8b0e8c35-fb99-4b6f-9386-e1c2a73665cf'} Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf could not be found. Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:45:36.785758 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf could not be found. Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf could not be found. Jun 30 16:45:36.787387 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:36.788898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-68c5a58e-ee60-478b-afd0-9902308d0965 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Returning 404 to user: Instance 8b0e8c35-fb99-4b6f-9386-e1c2a73665cf could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:45:36.788898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-68c5a58e-ee60-478b-afd0-9902308d0965 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf" status: 404 len: 111 microversion: 2.1 time: 0.032535 Jun 30 16:45:36.788898 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 576/1178] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:45:36 2022] GET /compute/v2.1/servers/8b0e8c35-fb99-4b6f-9386-e1c2a73665cf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:45:37.348473 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7b242985-d314-4ebc-a439-c4a68db88c2a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:37.350445 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.compute.api [None req-7b242985-d314-4ebc-a439-c4a68db88c2a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124815) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:37.356365 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7b242985-d314-4ebc-a439-c4a68db88c2a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:37.356821 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7b242985-d314-4ebc-a439-c4a68db88c2a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:37.357596 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7b242985-d314-4ebc-a439-c4a68db88c2a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:37.358037 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG oslo_concurrency.lockutils [None req-7b242985-d314-4ebc-a439-c4a68db88c2a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:37.373470 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.wsgi [None req-7b242985-d314-4ebc-a439-c4a68db88c2a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] HTTP exception thrown: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7b242985-d314-4ebc-a439-c4a68db88c2a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Request method failure captured: Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: request: DELETE /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 HTTP/1.1 Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept: application/json Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Accept-Encoding: identity Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Connection: close Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Length: 0 Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Content-Type: application/json Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Host: 10.222.0.67 Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Openstack-System-Scope: None Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: User-Agent: python-urllib3/1.26.9 Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Auth-Token: gAAAAABivdFKSuL379510th7MRHxDO2Bx_XY-IYFkeUTjH0H_tMoqAwI_akvpTpYg9ei9xNz-CijIvdzVYPO4UIA3C8V3MsHSgkp7qfVdqGtxGOrN9LXxp2opb4DIxUhnRLOET4Lf0Nyj-8JkJlXhXr7Ua8wFhAMUVBTRMh5bddde8tbhNOLlMg Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Id: None Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Domain-Name: None Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Identity-Status: Confirmed Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Is-Admin-Project: True Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Id: default Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Domain-Name: Default Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Id: 99847b649bfd4ca6a33cb2ea97ad0469 Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Project-Name: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Role: reader,member Jun 30 16:45:37.374150 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Roles: reader,member Jun 30 16:45:37.375938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/99847b649bfd4ca6a33cb2ea97ad0469"}]}] Jun 30 16:45:37.375938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:45:37.375938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Id: 99847b649bfd4ca6a33cb2ea97ad0469 Jun 30 16:45:37.375938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-Tenant-Name: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:45:37.375938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User: tempest-TestVolumeBootPattern-1904314065-project Jun 30 16:45:37.375938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Id: default Jun 30 16:45:37.375938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Domain-Name: Default Jun 30 16:45:37.375938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Id: bb8a8a4e8b634322a92992379c98b721 Jun 30 16:45:37.375938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: X-User-Name: tempest-TestVolumeBootPattern-1904314065-project Jun 30 16:45:37.375938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: method: > Jun 30 16:45:37.375938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: exception: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:45:37.375938 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: action_args: {'id': 'd8cb685e-c960-41dc-89ad-bc5cabc56565'} Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:45:37.376818 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:45:37.378241 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: ERROR nova.api.openstack.wsgi Jun 30 16:45:37.380078 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-7b242985-d314-4ebc-a439-c4a68db88c2a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Returning 404 to user: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. {{(pid=124815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:45:37.380078 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-7b242985-d314-4ebc-a439-c4a68db88c2a tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 404 len: 111 microversion: 2.1 time: 0.031063 Jun 30 16:45:37.380078 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 603/1179] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 30 16:45:37 2022] DELETE /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 30 16:45:37.384458 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1ee239ec-b3ff-421a-acea-dd79eae26979 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '>' {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:37.385187 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.compute.api [None req-1ee239ec-b3ff-421a-acea-dd79eae26979 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] [instance: d8cb685e-c960-41dc-89ad-bc5cabc56565] Fetching instance by UUID {{(pid=124814) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 30 16:45:37.391829 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1ee239ec-b3ff-421a-acea-dd79eae26979 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:37.392274 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1ee239ec-b3ff-421a-acea-dd79eae26979 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:37.393035 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1ee239ec-b3ff-421a-acea-dd79eae26979 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 30 16:45:37.393464 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG oslo_concurrency.lockutils [None req-1ee239ec-b3ff-421a-acea-dd79eae26979 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Lock "70849487-d146-4446-8c56-f6084f9b53dd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 30 16:45:37.407968 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.wsgi [None req-1ee239ec-b3ff-421a-acea-dd79eae26979 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] HTTP exception thrown: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1ee239ec-b3ff-421a-acea-dd79eae26979 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Request method failure captured: Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: request: GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 HTTP/1.1 Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept: application/json Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Accept-Encoding: identity Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Connection: close Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Length: 0 Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Content-Type: application/json Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Host: 10.222.0.67 Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Openstack-System-Scope: None Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: User-Agent: python-urllib3/1.26.9 Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Auth-Token: gAAAAABivdFKSuL379510th7MRHxDO2Bx_XY-IYFkeUTjH0H_tMoqAwI_akvpTpYg9ei9xNz-CijIvdzVYPO4UIA3C8V3MsHSgkp7qfVdqGtxGOrN9LXxp2opb4DIxUhnRLOET4Lf0Nyj-8JkJlXhXr7Ua8wFhAMUVBTRMh5bddde8tbhNOLlMg Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Id: None Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Domain-Name: None Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Identity-Status: Confirmed Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Is-Admin-Project: True Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Id: default Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Domain-Name: Default Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Id: 99847b649bfd4ca6a33cb2ea97ad0469 Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Project-Name: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Role: reader,member Jun 30 16:45:37.409478 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Roles: reader,member Jun 30 16:45:37.411145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_99847b649bfd4ca6a33cb2ea97ad0469"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/99847b649bfd4ca6a33cb2ea97ad0469"}]}] Jun 30 16:45:37.411145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:45:37.411145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Id: 99847b649bfd4ca6a33cb2ea97ad0469 Jun 30 16:45:37.411145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-Tenant-Name: tempest-TestVolumeBootPattern-1904314065 Jun 30 16:45:37.411145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User: tempest-TestVolumeBootPattern-1904314065-project Jun 30 16:45:37.411145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Id: default Jun 30 16:45:37.411145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Domain-Name: Default Jun 30 16:45:37.411145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Id: bb8a8a4e8b634322a92992379c98b721 Jun 30 16:45:37.411145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: X-User-Name: tempest-TestVolumeBootPattern-1904314065-project Jun 30 16:45:37.411145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: method: > Jun 30 16:45:37.411145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: exception: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:45:37.411145 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: action_args: {'id': 'd8cb685e-c960-41dc-89ad-bc5cabc56565'} Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: {{(pid=124814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 30 16:45:37.412078 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. Jun 30 16:45:37.413548 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: ERROR nova.api.openstack.wsgi Jun 30 16:45:37.414772 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: DEBUG nova.api.openstack.wsgi [None req-1ee239ec-b3ff-421a-acea-dd79eae26979 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Returning 404 to user: Instance d8cb685e-c960-41dc-89ad-bc5cabc56565 could not be found. {{(pid=124814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 30 16:45:37.414772 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO nova.api.openstack.requestlog [None req-1ee239ec-b3ff-421a-acea-dd79eae26979 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565" status: 404 len: 111 microversion: 2.1 time: 0.030391 Jun 30 16:45:37.414772 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: [pid: 124814|app: 0|req: 577/1180] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 30 16:45:37 2022] GET /compute/v2.1/servers/d8cb685e-c960-41dc-89ad-bc5cabc56565 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 30 16:45:38.980934 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: DEBUG nova.api.openstack.wsgi [None req-ae244fef-0867-414e-a158-3432f28bfd44 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] Calling method '.version_select at 0x7f38202d0b80>' {{(pid=124815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 30 16:45:39.076695 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO nova.api.openstack.requestlog [None req-ae244fef-0867-414e-a158-3432f28bfd44 tempest-TestVolumeBootPattern-1904314065 tempest-TestVolumeBootPattern-1904314065-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1686313724" status: 202 len: 0 microversion: 2.1 time: 0.100077 Jun 30 16:45:39.077273 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: [pid: 124815|app: 0|req: 604/1181] 10.222.0.67 () {58 vars in 1262 bytes} [Thu Jun 30 16:45:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1686313724 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 30 16:48:53.334638 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:48:53.335291 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Thu Jun 30 16:48:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 16:48:54.688495 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:48:54.689125 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Thu Jun 30 16:48:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 16:48:55.609194 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:48:55.609780 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Thu Jun 30 16:48:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 16:50:41.459517 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:50:41.460122 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Thu Jun 30 16:50:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 16:50:53.275049 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:50:53.275603 dv-cinder-836027-2-iscsi devstack@n-api.service[124815]: Thu Jun 30 16:50:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 30 16:50:55.128571 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 30 16:50:55.129163 dv-cinder-836027-2-iscsi devstack@n-api.service[124814]: Thu Jun 30 16:50:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!